[ 587.224778] env[70614]: INFO neutron.common.config [-] Logging enabled! [ 587.225032] env[70614]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev45 [ 587.225322] env[70614]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=70614) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 587.225607] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 587.225711] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 587.226558] env[70614]: WARNING oslo_policy.policy [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 587.226778] env[70614]: WARNING oslo_policy.policy [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 587.228297] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] VMware NSXv3 Agent initialized successfully. [ 587.228656] env[70614]: DEBUG oslo_concurrency.lockutils [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] Acquiring lock "singleton_lock" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.228790] env[70614]: DEBUG oslo_concurrency.lockutils [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] Acquired lock "singleton_lock" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.228994] env[70614]: DEBUG oslo_concurrency.lockutils [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] Releasing lock "singleton_lock" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.229380] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] Full set of CONF: {{(pid=70614) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/eventlet/service.py:357}} [ 587.229506] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] ******************************************************************************** {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 587.229618] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] Configuration options gathered from: {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 587.229881] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 587.230065] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 587.230182] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] ================================================================================ {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 587.230358] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] agent_down_time = 75 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.230525] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] allow_automatic_dhcp_failover = True {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.230679] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] allow_bulk = True {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.230831] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] api_extensions_path = {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.230978] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] api_paste_config = api-paste.ini {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.231139] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] auth_strategy = keystone {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.231256] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] backdoor_port = None {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.231360] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] backdoor_socket = None {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.231504] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] backlog = 4096 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.231647] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] base_mac = fa:16:3e:00:00:00 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.231898] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] bind_host = 0.0.0.0 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.231961] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] bind_port = 9696 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.232096] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] client_socket_timeout = 900 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.232248] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] config_dir = [] {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.232535] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.232535] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] config_source = [] {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.232682] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] control_exchange = neutron {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.232832] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] core_plugin = ml2 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.232977] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] debug = True {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.233134] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] default_availability_zones = [] {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.233416] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.233530] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] dhcp_agent_notification = True {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.233661] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] dhcp_agents_per_network = 1 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.233805] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] dhcp_lease_duration = 86400 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.233954] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] dhcp_load_type = networks {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.234106] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] dns_domain = openstacklocal {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.234263] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.234385] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] enable_default_route_bfd = False {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.234524] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] enable_default_route_ecmp = False {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.234686] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] enable_dvr = True {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.234802] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] enable_new_agents = True {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.234925] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] enable_services_on_agents_with_admin_state_down = False {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.235071] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] enable_signals = True {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.235247] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] enable_traditional_dhcp = True {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.235361] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] external_dns_driver = None {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.235505] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] filter_validation = True {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.235653] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] global_physnet_mtu = 8950 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.235790] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] graceful_shutdown_timeout = 60 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.235974] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] host = cpu-1 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.236131] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] host_dvr_for_dhcp = True {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.236305] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] http_retries = 3 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.236480] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] instance_format = [instance: %(uuid)s] {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.236628] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.236770] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] ipam_driver = internal {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.236908] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] ipv6_pd_enabled = False {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.237058] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] l3_ha = False {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.237202] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.237344] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] l3_ha_network_physical_name = {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.237487] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] l3_ha_network_type = {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.237629] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] log_color = False {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.237767] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] log_config_append = None {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.237907] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.238059] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] log_dir = None {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.238197] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] log_file = None {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.238305] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] log_options = True {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.238445] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] log_rotate_interval = 1 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.238589] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] log_rotate_interval_type = days {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.238729] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] log_rotation_type = none {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.238840] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.238948] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.239103] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.239258] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.239382] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.239530] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] max_dns_nameservers = 5 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.239670] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] max_header_line = 16384 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.239806] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] max_l3_agents_per_router = 3 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.239942] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] max_logfile_count = 30 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.240094] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] max_logfile_size_mb = 200 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.240228] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] max_subnet_host_routes = 20 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.240373] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] my_ip = 10.180.1.21 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.240518] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] my_ipv6 = ::1 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.240659] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] network_auto_schedule = True {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.240794] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] network_link_prefix = None {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.240934] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.241096] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] notify_nova_on_port_data_changes = True {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.241235] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] notify_nova_on_port_status_changes = True {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.241377] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] pagination_max_limit = -1 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.241515] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] publish_errors = False {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.241654] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] rate_limit_burst = 0 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.241800] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] rate_limit_except_level = CRITICAL {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.241940] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] rate_limit_interval = 0 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.242096] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] retry_until_window = 30 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.242241] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] router_distributed = False {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.242403] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] rpc_resources_processing_step = 20 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.242548] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] rpc_response_max_timeout = 600 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.242690] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] rpc_response_timeout = 60 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.242829] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] send_events_interval = 2 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.242994] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] service_plugins = ['router'] {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.243141] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] setproctitle = on {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.243278] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] shell_completion = None {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.243424] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] state_path = /opt/stack/data/neutron {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.243567] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] syslog_log_facility = LOG_USER {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.243706] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] tcp_keepidle = 600 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.243849] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] transport_url = **** {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.243987] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] use_journal = False {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.244136] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] use_json = False {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.244274] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] use_ssl = False {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.244411] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] use_stderr = False {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.244553] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] use_syslog = False {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.244690] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] vlan_qinq = False {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.244880] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] vlan_transparent = False {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.245063] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] watch_log_file = False {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.245210] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] wsgi_default_pool_size = 100 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.245404] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] wsgi_keep_alive = True {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.245544] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.245675] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] wsgi_server_debug = False {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 587.245835] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] oslo_concurrency.disable_process_locking = False {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.245987] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.246151] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.246294] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.246444] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] oslo_messaging_metrics.metrics_process_name = {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.246586] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.246727] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.246883] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] profiler.connection_string = messaging:// {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.247043] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] profiler.enabled = False {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.247194] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] profiler.es_doc_type = notification {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.247338] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] profiler.es_scroll_size = 10000 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.247485] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] profiler.es_scroll_time = 2m {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.247634] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] profiler.filter_error_trace = False {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.247772] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] profiler.hmac_keys = **** {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.247916] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] profiler.sentinel_service_name = mymaster {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.248077] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] profiler.socket_timeout = 0.1 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.248218] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] profiler.trace_requests = False {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.248375] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] profiler.trace_sqlalchemy = False {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.248550] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] profiler_jaeger.process_tags = {} {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.248694] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] profiler_jaeger.service_name_prefix = None {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.248836] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] profiler_otlp.service_name_prefix = None {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.248992] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] oslo_policy.enforce_new_defaults = True {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.249293] env[70614]: WARNING oslo_config.cfg [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 587.249455] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] oslo_policy.enforce_scope = True {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.249608] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] oslo_policy.policy_default_rule = default {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.249763] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.249912] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.250073] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.250218] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.250360] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.250579] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.250725] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.250874] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] oslo_policy.remote_timeout = 60.0 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.251043] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.251201] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] agent.extensions = [] {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.251366] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.251542] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] service_providers.service_provider = [] {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.251698] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] QUOTAS.default_quota = -1 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.251847] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.251988] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] QUOTAS.quota_floatingip = 50 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.252144] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] QUOTAS.quota_network = 100 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.252284] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] QUOTAS.quota_port = 500 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.252423] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] QUOTAS.quota_rbac_policy = 10 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.252560] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] QUOTAS.quota_router = 10 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.252697] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] QUOTAS.quota_security_group = 10 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.252832] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] QUOTAS.quota_security_group_rule = 100 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.252966] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] QUOTAS.quota_subnet = 100 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.253115] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] QUOTAS.track_quota_usage = True {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.253273] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.253406] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] privsep.group = None {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.253542] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] privsep.helper_command = None {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.253684] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] privsep.logger_name = oslo_privsep.daemon {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.253825] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] privsep.thread_pool_size = 8 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.253961] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] privsep.user = None {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.254120] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.254255] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] privsep_dhcp_release.group = None {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.254393] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] privsep_dhcp_release.helper_command = None {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.254556] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.254698] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.254834] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] privsep_dhcp_release.user = None {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.254980] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.255129] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] privsep_ovs_vsctl.group = None {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.255263] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] privsep_ovs_vsctl.helper_command = None {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.255427] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.255578] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.255702] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] privsep_ovs_vsctl.user = None {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.255845] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] privsep_namespace.capabilities = [21] {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.255981] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] privsep_namespace.group = None {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.256125] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] privsep_namespace.helper_command = None {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.256269] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.256429] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] privsep_namespace.thread_pool_size = 8 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.256573] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] privsep_namespace.user = None {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.256719] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] privsep_conntrack.capabilities = [12] {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.256855] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] privsep_conntrack.group = None {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.256990] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] privsep_conntrack.helper_command = None {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.257144] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.257286] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] privsep_conntrack.thread_pool_size = 8 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.257429] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] privsep_conntrack.user = None {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.257595] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] privsep_link.capabilities = [12, 21] {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.257734] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] privsep_link.group = None {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.257868] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] privsep_link.helper_command = None {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.258016] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.258160] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] privsep_link.thread_pool_size = 8 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.258293] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] privsep_link.user = None {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.258452] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.258598] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.258737] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] AGENT.continue_on_failed_promotions = False {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.258872] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] AGENT.dscp = None {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.259019] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] AGENT.dscp_inherit = False {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.259167] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] AGENT.force_mp_to_policy = True {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.259306] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] AGENT.locking_coordinator_url = None {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.259449] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] AGENT.log_agent_heartbeats = False {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.259590] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] AGENT.logging_expire = 1 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.259736] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.259877] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.260032] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] AGENT.polling_interval = 240 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.260178] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.260327] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] AGENT.quitting_rpc_timeout = 120 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.260489] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] AGENT.report_interval = 30.0 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.260652] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.260800] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.260947] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.261102] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] AGENT.sync_skew = 60 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.261249] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] AGENT.synchronization_queue_size = 20 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.261395] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] AGENT.use_helper_for_ns_read = True {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.261544] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] SECURITYGROUP.enable_ipset = True {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.261693] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] SECURITYGROUP.enable_security_group = True {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.261839] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.261983] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.262141] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] experimental.ipv6_pd_enabled = False {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.262300] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] ml2.extension_drivers = ['port_security'] {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.262440] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] ml2.external_network_type = None {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.262622] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.262786] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] ml2.overlay_ip_version = 4 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.262933] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] ml2.path_mtu = 8950 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.263090] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] ml2.physical_network_mtus = {} {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.263271] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] ml2.tenant_network_types = ['vlan'] {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.263426] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.263577] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] ml2.type_drivers = ['vlan'] {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.263727] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] AGENT_CLI.neutron_port_id = [] {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.263869] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.264026] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.264173] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.264321] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.264468] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.264613] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.264757] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.264900] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.265117] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.265278] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] NSXV3.nsxv3_login_password = **** {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.265450] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] NSXV3.nsxv3_login_port = 443 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.265621] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] NSXV3.nsxv3_login_user = admin {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.265745] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.265892] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.266046] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.266190] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.266370] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.266539] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.266692] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.266839] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.266981] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.267142] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.267293] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.267438] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.267581] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.267778] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.267929] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] vsphere.vsphere_login_password = VMware1! {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.268085] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.268228] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.268374] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] nova.auth_section = None {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.268525] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] nova.auth_type = password {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.268671] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.268808] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] nova.certfile = None {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.268946] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] nova.collect_timing = False {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.269104] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] nova.endpoint_type = public {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.269253] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] nova.insecure = False {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.269405] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] nova.keyfile = None {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.269555] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] nova.region_name = RegionOne {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.269695] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] nova.split_loggers = False {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.269832] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] nova.timeout = None {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.269975] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] placement.auth_section = None {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.270138] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] placement.auth_type = password {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.270285] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.270423] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] placement.certfile = None {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.270562] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] placement.collect_timing = False {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.270710] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] placement.endpoint_type = public {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.270885] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] placement.insecure = False {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.271032] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] placement.keyfile = None {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.271186] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] placement.region_name = None {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.271336] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] placement.split_loggers = False {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.271473] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] placement.timeout = None {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.271639] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] ironic.auth_section = None {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.271781] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] ironic.auth_type = None {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.271936] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] ironic.cafile = None {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.272084] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] ironic.certfile = None {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.272237] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] ironic.collect_timing = False {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.272396] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] ironic.connect_retries = None {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.272536] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] ironic.connect_retry_delay = None {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.272675] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] ironic.enable_notifications = False {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.272811] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] ironic.endpoint_override = None {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.272947] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] ironic.insecure = False {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.273095] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] ironic.interface = None {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.273231] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] ironic.keyfile = None {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.273365] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] ironic.max_version = None {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.273499] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] ironic.min_version = None {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.273632] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] ironic.region_name = None {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.273763] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] ironic.retriable_status_codes = None {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.273895] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] ironic.service_name = None {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.274037] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] ironic.service_type = None {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.274182] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] ironic.split_loggers = False {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.274316] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] ironic.status_code_retries = None {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.274452] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] ironic.status_code_retry_delay = None {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.274609] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] ironic.timeout = None {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.274765] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] ironic.valid_interfaces = None {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.274902] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] ironic.version = None {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.275057] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] cli_script.dry_run = False {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.275210] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.275381] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.275529] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.275737] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.275809] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.275937] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.276086] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.276226] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.276365] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.276508] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] oslo_messaging_rabbit.hostname = devstack {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.276642] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.276786] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.276929] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.277080] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.277220] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.277362] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.277500] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.277751] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.277784] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.277913] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.278074] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.278197] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.278350] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.278525] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.278670] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.278809] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.278947] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.279098] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.279237] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.279376] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.279514] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] oslo_messaging_rabbit.ssl = False {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.279659] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.279802] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.279940] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.280092] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.280235] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] oslo_messaging_rabbit.ssl_version = {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.280372] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.280521] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] oslo_messaging_notifications.driver = [] {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.280660] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] oslo_messaging_notifications.retry = -1 {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.280810] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.280946] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] oslo_messaging_notifications.transport_url = **** {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 587.281065] env[70614]: DEBUG oslo_service.backend.eventlet.service [None req-c8c709ee-b492-4a89-9106-342d8f6ca7ac None None] ******************************************************************************** {{(pid=70614) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 587.282121] env[70614]: DEBUG neutron.agent.securitygroups_rpc [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] Init firewall settings (driver=nsxv3) {{(pid=70614) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 587.283439] env[70614]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=70614) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 587.283681] env[70614]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] RPC agent_id: nsxm-l-01a.corp.local [ 587.285977] env[70614]: DEBUG dogpile.cache.region [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 587.286113] env[70614]: DEBUG dogpile.lock [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 587.286243] env[70614]: DEBUG dogpile.lock [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 587.286302] env[70614]: DEBUG dogpile.lock [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 587.286421] env[70614]: DEBUG dogpile.cache.region [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 587.286531] env[70614]: DEBUG dogpile.lock [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 587.286664] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 587.323478] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] Session token - acquiring [ 587.325574] env[70614]: DEBUG networking_nsxv3.common.locking [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.325819] env[70614]: DEBUG oslo_concurrency.lockutils [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.325891] env[70614]: DEBUG oslo_concurrency.lockutils [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.326314] env[70614]: DEBUG oslo_concurrency.lockutils [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.336910] env[70614]: DEBUG oslo_concurrency.lockutils [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.618256] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 587.639577] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 587.639761] env[70614]: DEBUG dogpile.cache.region [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] Cache value generated in 0.353 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 587.639894] env[70614]: DEBUG dogpile.lock [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 587.639985] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] Activating Policy API Provider. [ 587.640174] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] Looking for the default Infrastructure Rules. [ 587.715136] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] Looking for the Default Layer3 Logged Drop Section. [ 587.729460] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 587.729988] env[70614]: DEBUG networking_nsxv3.common.locking [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.730221] env[70614]: DEBUG oslo_concurrency.lockutils [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] Acquiring lock "all" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.730337] env[70614]: DEBUG oslo_concurrency.lockutils [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] Acquired lock "all" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.730627] env[70614]: DEBUG oslo_concurrency.lockutils [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] Acquired external semaphore "all" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.731041] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.246173] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.749042] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.251741] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] Inventory metadata is going to be refreshed. [ 589.252209] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 590.072517] env[70614]: DEBUG networking_nsxv3.common.locking [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.072767] env[70614]: DEBUG oslo_concurrency.lockutils [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.072830] env[70614]: DEBUG oslo_concurrency.lockutils [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.073135] env[70614]: DEBUG oslo_concurrency.lockutils [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.083723] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 590.084640] env[70614]: DEBUG oslo_concurrency.lockutils [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.085696] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 590.104686] env[70614]: DEBUG networking_nsxv3.common.locking [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.104916] env[70614]: DEBUG oslo_concurrency.lockutils [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.104986] env[70614]: DEBUG oslo_concurrency.lockutils [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.105302] env[70614]: DEBUG oslo_concurrency.lockutils [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.105522] env[70614]: DEBUG oslo_concurrency.lockutils [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.105682] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 590.105802] env[70614]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=70614) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 590.105927] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 590.125061] env[70614]: DEBUG networking_nsxv3.common.locking [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.125367] env[70614]: DEBUG oslo_concurrency.lockutils [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.125420] env[70614]: DEBUG oslo_concurrency.lockutils [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.125727] env[70614]: DEBUG oslo_concurrency.lockutils [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.125913] env[70614]: DEBUG oslo_concurrency.lockutils [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.126075] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 590.147151] env[70614]: DEBUG networking_nsxv3.common.locking [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.147388] env[70614]: DEBUG oslo_concurrency.lockutils [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.147425] env[70614]: DEBUG oslo_concurrency.lockutils [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.147761] env[70614]: DEBUG oslo_concurrency.lockutils [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.147909] env[70614]: DEBUG oslo_concurrency.lockutils [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.148074] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 590.170089] env[70614]: DEBUG networking_nsxv3.common.locking [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.170284] env[70614]: DEBUG oslo_concurrency.lockutils [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] Acquiring lock "Address Group" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.170431] env[70614]: DEBUG oslo_concurrency.lockutils [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] Acquired lock "Address Group" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.170791] env[70614]: DEBUG oslo_concurrency.lockutils [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] Acquired external semaphore "Address Group" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.170963] env[70614]: DEBUG oslo_concurrency.lockutils [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] Releasing lock "Address Group" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.171043] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 590.171097] env[70614]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=70614) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 590.171220] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 590.190146] env[70614]: DEBUG networking_nsxv3.common.locking [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.190438] env[70614]: DEBUG oslo_concurrency.lockutils [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] Acquiring lock "Segment QoS" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.190438] env[70614]: DEBUG oslo_concurrency.lockutils [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] Acquired lock "Segment QoS" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.190733] env[70614]: DEBUG oslo_concurrency.lockutils [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] Acquired external semaphore "Segment QoS" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.190862] env[70614]: DEBUG oslo_concurrency.lockutils [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] Releasing lock "Segment QoS" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.191016] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 590.191171] env[70614]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=70614) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 590.191247] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 590.212416] env[70614]: DEBUG networking_nsxv3.common.locking [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.212654] env[70614]: DEBUG oslo_concurrency.lockutils [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.212707] env[70614]: DEBUG oslo_concurrency.lockutils [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.212979] env[70614]: DEBUG oslo_concurrency.lockutils [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.213133] env[70614]: DEBUG oslo_concurrency.lockutils [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.213463] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 590.213576] env[70614]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=70614) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 590.213683] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] Inventory metadata have been refreshed. [ 590.213786] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] Dryrun:True. Metadata refresh completed. [ 590.213909] env[70614]: DEBUG oslo_concurrency.lockutils [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] Releasing lock "all" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.215686] env[70614]: INFO neutron.agent.agent_extensions_manager [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] Loaded agent extensions: [] [ 590.216436] env[70614]: DEBUG neutron_lib.callbacks.manager [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=70614) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 590.263079] env[70614]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] NSXv3 Agent Agent RPC Daemon Started! [ 590.263451] env[70614]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] NSXv3 Agent Agent loop - iteration:0 started [ 590.263451] env[70614]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] NSXv3 Agent Agent out of sync with plugin! [ 595.218030] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 595.218030] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 600.219526] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 600.219917] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 605.108857] env[70614]: INFO networking_nsxv3.common.synchronization [None req-b0256085-b6d0-4bb1-8923-a67540fc4d45 demo admin] Enqueued Resource ID: 9d265570-badc-4b72-b850-b4fe444e5d3e with Priority: HIGHEST for action security_group_rules [ 605.109401] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d265570-badc-4b72-b850-b4fe444e5d3e with Priority: HIGHEST for action security_group_rules [ 605.109721] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9d265570-badc-4b72-b850-b4fe444e5d3e taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.109856] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9d265570-badc-4b72-b850-b4fe444e5d3e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.109927] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9d265570-badc-4b72-b850-b4fe444e5d3e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.110300] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9d265570-badc-4b72-b850-b4fe444e5d3e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.110395] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9d265570-badc-4b72-b850-b4fe444e5d3e',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.630319] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.630530] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.630602] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.630789] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.630880] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.631039] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9d265570-badc-4b72-b850-b4fe444e5d3e already deleted. [ 605.631212] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9d265570-badc-4b72-b850-b4fe444e5d3e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.111323] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 610.111323] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 615.112787] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 615.112787] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 620.114469] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 620.114883] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 625.116333] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 625.116753] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 630.117932] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 630.118236] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 632.219462] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.219818] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.219818] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.219818] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.220070] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.723129] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.226882] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.729324] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 633.729460] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 634.024850] env[70614]: INFO networking_nsxv3.common.synchronization [None req-acc1a655-3058-4759-b9ae-56ebd7f3f02c None None] Enqueued Resource ID: 1eca89b8-53bd-427c-91c4-7545e27f37f5 with Priority: HIGHEST for action port [ 634.025926] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1eca89b8-53bd-427c-91c4-7545e27f37f5 with Priority: HIGHEST for action port [ 634.025926] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-1eca89b8-53bd-427c-91c4-7545e27f37f5 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.025926] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1eca89b8-53bd-427c-91c4-7545e27f37f5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.025926] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1eca89b8-53bd-427c-91c4-7545e27f37f5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.025926] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1eca89b8-53bd-427c-91c4-7545e27f37f5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.026173] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1eca89b8-53bd-427c-91c4-7545e27f37f5',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.515938] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.515938] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.515938] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.515938] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.532540] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 634.533666] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.534933] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 634.536087] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1eca89b8-53bd-427c-91c4-7545e27f37f5 [ 634.536292] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.536419] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.536677] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.536920] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.537045] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.537164] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1eca89b8-53bd-427c-91c4-7545e27f37f5 already deleted. [ 634.537252] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1eca89b8-53bd-427c-91c4-7545e27f37f5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.559022] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.559022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.559022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.559022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.559022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.559022] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 634.559022] env[70614]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=70614) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 634.559022] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 634.582827] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.583089] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.583158] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.583373] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.583515] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.584897] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 634.604182] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.604390] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.604390] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.604606] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.604712] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.604821] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 634.628369] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.628604] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.628604] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.628782] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.628858] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.628978] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 634.629077] env[70614]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=70614) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 634.629144] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 634.648544] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.648544] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.648544] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.649053] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.649053] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.649053] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 634.649053] env[70614]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=70614) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 634.649182] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 634.670469] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.670744] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.671152] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.675554] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.675680] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.675905] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 634.675905] env[70614]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=70614) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 634.676033] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 634.676069] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 634.676180] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 634.676236] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 634.676268] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 634.676548] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 634.676626] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 634.676682] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 634.698228] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.698373] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.698447] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.698652] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.698760] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.698868] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 634.726458] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.726572] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.727158] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.727434] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.727546] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.741879] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.303565] env[70614]: INFO networking_nsxv3.common.synchronization [None req-f2b333a2-a3f1-441d-92ce-5b6b6288c8ef None None] Enqueued Resource ID: b2dc2836-af14-4260-9946-d4db5a28952b with Priority: HIGHEST for action port [ 635.303847] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2dc2836-af14-4260-9946-d4db5a28952b with Priority: HIGHEST for action port [ 635.304493] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-b2dc2836-af14-4260-9946-d4db5a28952b taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.304719] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b2dc2836-af14-4260-9946-d4db5a28952b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.304719] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b2dc2836-af14-4260-9946-d4db5a28952b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.305113] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b2dc2836-af14-4260-9946-d4db5a28952b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.305243] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2dc2836-af14-4260-9946-d4db5a28952b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.808417] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b2dc2836-af14-4260-9946-d4db5a28952b [ 635.808713] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.808793] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.808882] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.809153] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.812698] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.812698] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b2dc2836-af14-4260-9946-d4db5a28952b already deleted. [ 635.812799] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b2dc2836-af14-4260-9946-d4db5a28952b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.919108] env[70614]: INFO networking_nsxv3.common.synchronization [None req-7e1afbdb-347f-4fdd-a64c-9f13cb6b8790 None None] Enqueued Resource ID: f350f560-26e7-4f5f-a1d8-2bd8979cf65c with Priority: HIGHEST for action port [ 635.919364] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f350f560-26e7-4f5f-a1d8-2bd8979cf65c with Priority: HIGHEST for action port [ 635.920834] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-f350f560-26e7-4f5f-a1d8-2bd8979cf65c taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.920834] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f350f560-26e7-4f5f-a1d8-2bd8979cf65c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.920834] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f350f560-26e7-4f5f-a1d8-2bd8979cf65c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.920834] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f350f560-26e7-4f5f-a1d8-2bd8979cf65c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.920834] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f350f560-26e7-4f5f-a1d8-2bd8979cf65c',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.427429] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f350f560-26e7-4f5f-a1d8-2bd8979cf65c [ 636.427765] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.427865] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.427865] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.428116] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.428225] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.428330] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f350f560-26e7-4f5f-a1d8-2bd8979cf65c already deleted. [ 636.428409] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f350f560-26e7-4f5f-a1d8-2bd8979cf65c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.684064] env[70614]: INFO networking_nsxv3.common.synchronization [None req-7e407176-8f11-46a8-97d8-f10cc8a867e8 None None] Enqueued Resource ID: f7377989-012f-4b8f-a1fd-db84331e9964 with Priority: HIGHEST for action port [ 637.684685] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7377989-012f-4b8f-a1fd-db84331e9964 with Priority: HIGHEST for action port [ 637.685026] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-f7377989-012f-4b8f-a1fd-db84331e9964 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.685115] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f7377989-012f-4b8f-a1fd-db84331e9964" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.685182] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f7377989-012f-4b8f-a1fd-db84331e9964" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.685439] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f7377989-012f-4b8f-a1fd-db84331e9964" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.685533] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7377989-012f-4b8f-a1fd-db84331e9964',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.747041] env[70614]: INFO networking_nsxv3.common.synchronization [None req-03b3752e-4f4f-4c26-972f-2920520c8a08 None None] Enqueued Resource ID: c00d8b62-ab97-4117-9abc-20430a3e4477 with Priority: HIGHEST for action port [ 637.748439] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c00d8b62-ab97-4117-9abc-20430a3e4477 with Priority: HIGHEST for action port [ 637.748439] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-c00d8b62-ab97-4117-9abc-20430a3e4477 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.748439] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c00d8b62-ab97-4117-9abc-20430a3e4477" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.750091] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c00d8b62-ab97-4117-9abc-20430a3e4477" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.750377] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c00d8b62-ab97-4117-9abc-20430a3e4477" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.750467] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c00d8b62-ab97-4117-9abc-20430a3e4477',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.188574] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f7377989-012f-4b8f-a1fd-db84331e9964 [ 638.188821] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.188959] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.189044] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.189260] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.189346] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.189451] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f7377989-012f-4b8f-a1fd-db84331e9964 already deleted. [ 638.189518] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f7377989-012f-4b8f-a1fd-db84331e9964" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.260064] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c00d8b62-ab97-4117-9abc-20430a3e4477 [ 638.260064] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.260064] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.260064] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.260064] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.260468] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.260468] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c00d8b62-ab97-4117-9abc-20430a3e4477 already deleted. [ 638.260468] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c00d8b62-ab97-4117-9abc-20430a3e4477" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.746912] env[70614]: INFO networking_nsxv3.common.synchronization [None req-08f32505-011c-4ecb-b1e3-b133578c03ed None None] Enqueued Resource ID: 4d920180-7dda-450d-8468-1bb0f9c22793 with Priority: HIGHEST for action port [ 638.747584] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d920180-7dda-450d-8468-1bb0f9c22793 with Priority: HIGHEST for action port [ 638.747913] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-4d920180-7dda-450d-8468-1bb0f9c22793 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.748080] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4d920180-7dda-450d-8468-1bb0f9c22793" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.748146] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4d920180-7dda-450d-8468-1bb0f9c22793" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.748991] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4d920180-7dda-450d-8468-1bb0f9c22793" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.748991] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d920180-7dda-450d-8468-1bb0f9c22793',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.252080] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4d920180-7dda-450d-8468-1bb0f9c22793 [ 639.252317] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.252455] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.252528] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.252749] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.252846] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.252943] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4d920180-7dda-450d-8468-1bb0f9c22793 already deleted. [ 639.253051] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4d920180-7dda-450d-8468-1bb0f9c22793" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.492950] env[70614]: INFO networking_nsxv3.common.synchronization [None req-47fcd65d-23bf-4069-aa33-d97996cdce02 None None] Enqueued Resource ID: 00accb0f-866e-4ed7-9148-00d7c996b3c5 with Priority: HIGHEST for action port [ 639.493394] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00accb0f-866e-4ed7-9148-00d7c996b3c5 with Priority: HIGHEST for action port [ 639.493782] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-00accb0f-866e-4ed7-9148-00d7c996b3c5 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.493918] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-00accb0f-866e-4ed7-9148-00d7c996b3c5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.493997] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-00accb0f-866e-4ed7-9148-00d7c996b3c5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.494276] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-00accb0f-866e-4ed7-9148-00d7c996b3c5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.494364] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('00accb0f-866e-4ed7-9148-00d7c996b3c5',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.503077] env[70614]: INFO networking_nsxv3.common.synchronization [None req-c448408b-2205-4238-a1fa-780aaa3418b7 None None] Enqueued Resource ID: b7c220e8-c3fb-4bae-9d0e-f8ceea1d1a1a with Priority: HIGHEST for action port [ 639.503326] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7c220e8-c3fb-4bae-9d0e-f8ceea1d1a1a with Priority: HIGHEST for action port [ 639.503839] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-b7c220e8-c3fb-4bae-9d0e-f8ceea1d1a1a taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.503967] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b7c220e8-c3fb-4bae-9d0e-f8ceea1d1a1a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.504050] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b7c220e8-c3fb-4bae-9d0e-f8ceea1d1a1a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.504284] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b7c220e8-c3fb-4bae-9d0e-f8ceea1d1a1a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.504370] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7c220e8-c3fb-4bae-9d0e-f8ceea1d1a1a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.999406] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 00accb0f-866e-4ed7-9148-00d7c996b3c5 [ 639.999406] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.999406] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.999406] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.999406] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.999406] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.999406] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:00accb0f-866e-4ed7-9148-00d7c996b3c5 already deleted. [ 639.999406] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-00accb0f-866e-4ed7-9148-00d7c996b3c5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.007812] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b7c220e8-c3fb-4bae-9d0e-f8ceea1d1a1a [ 640.008893] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.009169] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.009319] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.009629] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.009826] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.010050] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b7c220e8-c3fb-4bae-9d0e-f8ceea1d1a1a already deleted. [ 640.010248] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b7c220e8-c3fb-4bae-9d0e-f8ceea1d1a1a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.552529] env[70614]: INFO networking_nsxv3.common.synchronization [None req-698cb99c-0060-4570-95cb-7747261ddfc1 None None] Enqueued Resource ID: bf7f4e3a-a8c9-4e65-b8e1-72bd6ce70db0 with Priority: HIGHEST for action port [ 641.553542] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf7f4e3a-a8c9-4e65-b8e1-72bd6ce70db0 with Priority: HIGHEST for action port [ 641.554186] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf7f4e3a-a8c9-4e65-b8e1-72bd6ce70db0 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.554260] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf7f4e3a-a8c9-4e65-b8e1-72bd6ce70db0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.554341] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf7f4e3a-a8c9-4e65-b8e1-72bd6ce70db0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.554583] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf7f4e3a-a8c9-4e65-b8e1-72bd6ce70db0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.554666] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf7f4e3a-a8c9-4e65-b8e1-72bd6ce70db0',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.975930] env[70614]: INFO networking_nsxv3.common.synchronization [None req-5afdd926-63a4-4539-9dfa-c2301e0493d0 None None] Enqueued Resource ID: 6bb0fb9d-8bba-45cb-9205-64ad27f0bc3d with Priority: HIGHEST for action port [ 641.976346] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6bb0fb9d-8bba-45cb-9205-64ad27f0bc3d with Priority: HIGHEST for action port [ 641.980313] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-6bb0fb9d-8bba-45cb-9205-64ad27f0bc3d taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.980538] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6bb0fb9d-8bba-45cb-9205-64ad27f0bc3d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.980538] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6bb0fb9d-8bba-45cb-9205-64ad27f0bc3d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.981137] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6bb0fb9d-8bba-45cb-9205-64ad27f0bc3d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.981137] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6bb0fb9d-8bba-45cb-9205-64ad27f0bc3d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.058954] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bf7f4e3a-a8c9-4e65-b8e1-72bd6ce70db0 [ 642.059836] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.059987] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.059987] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.060768] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.060768] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.060768] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bf7f4e3a-a8c9-4e65-b8e1-72bd6ce70db0 already deleted. [ 642.060768] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf7f4e3a-a8c9-4e65-b8e1-72bd6ce70db0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.330187] env[70614]: INFO networking_nsxv3.common.synchronization [None req-b93dbb50-2ab2-4458-86a5-c631225e93f3 None None] Enqueued Resource ID: 950df7e1-4b23-475c-bbfc-7f90f6c601d9 with Priority: HIGHEST for action port [ 642.330511] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 950df7e1-4b23-475c-bbfc-7f90f6c601d9 with Priority: HIGHEST for action port [ 642.331063] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-950df7e1-4b23-475c-bbfc-7f90f6c601d9 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.331182] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-950df7e1-4b23-475c-bbfc-7f90f6c601d9" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.331249] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-950df7e1-4b23-475c-bbfc-7f90f6c601d9" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.331493] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-950df7e1-4b23-475c-bbfc-7f90f6c601d9" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.331572] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('950df7e1-4b23-475c-bbfc-7f90f6c601d9',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.485453] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6bb0fb9d-8bba-45cb-9205-64ad27f0bc3d [ 642.485667] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.487031] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.487031] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.487031] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.487031] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.487031] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6bb0fb9d-8bba-45cb-9205-64ad27f0bc3d already deleted. [ 642.487031] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6bb0fb9d-8bba-45cb-9205-64ad27f0bc3d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.836515] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 950df7e1-4b23-475c-bbfc-7f90f6c601d9 [ 642.836875] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.837263] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.837263] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.837750] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.837846] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.842020] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:950df7e1-4b23-475c-bbfc-7f90f6c601d9 already deleted. [ 642.842020] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-950df7e1-4b23-475c-bbfc-7f90f6c601d9" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.605744] env[70614]: INFO networking_nsxv3.common.synchronization [None req-99c54dcc-5e42-453c-a4fe-24797b567629 None None] Enqueued Resource ID: fa8f7940-0795-448f-8b76-c25517f7d548 with Priority: HIGHEST for action port [ 643.606014] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa8f7940-0795-448f-8b76-c25517f7d548 with Priority: HIGHEST for action port [ 643.607771] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-fa8f7940-0795-448f-8b76-c25517f7d548 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.607771] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fa8f7940-0795-448f-8b76-c25517f7d548" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.607771] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fa8f7940-0795-448f-8b76-c25517f7d548" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.607771] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fa8f7940-0795-448f-8b76-c25517f7d548" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.607771] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa8f7940-0795-448f-8b76-c25517f7d548',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.681668] env[70614]: INFO networking_nsxv3.common.synchronization [None req-a1023c7a-3672-41a5-85c5-686fdc7b2473 tempest-AttachInterfacesTestJSON-1919943007 tempest-AttachInterfacesTestJSON-1919943007-project-member] Enqueued Resource ID: ebcad34a-a932-4aaf-93de-b0493166d0cf with Priority: HIGHEST for action security_group_rules [ 643.682219] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebcad34a-a932-4aaf-93de-b0493166d0cf with Priority: HIGHEST for action security_group_rules [ 643.682521] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ebcad34a-a932-4aaf-93de-b0493166d0cf taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.683809] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ebcad34a-a932-4aaf-93de-b0493166d0cf" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.683809] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ebcad34a-a932-4aaf-93de-b0493166d0cf" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.684023] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ebcad34a-a932-4aaf-93de-b0493166d0cf" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.686217] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ebcad34a-a932-4aaf-93de-b0493166d0cf',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.798722] env[70614]: INFO networking_nsxv3.common.synchronization [None req-ec59ff25-9e6d-441d-81a8-adc4fd594503 tempest-AttachInterfacesTestJSON-1919943007 tempest-AttachInterfacesTestJSON-1919943007-project-member] Enqueued Resource ID: ebcad34a-a932-4aaf-93de-b0493166d0cf with Priority: HIGHEST for action security_group_rules [ 643.798919] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebcad34a-a932-4aaf-93de-b0493166d0cf with Priority: HIGHEST for action security_group_rules [ 643.800196] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ebcad34a-a932-4aaf-93de-b0493166d0cf taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.800196] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ebcad34a-a932-4aaf-93de-b0493166d0cf" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.110036] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fa8f7940-0795-448f-8b76-c25517f7d548 [ 644.110291] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.110420] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.110561] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.110693] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.110870] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.110870] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fa8f7940-0795-448f-8b76-c25517f7d548 already deleted. [ 644.111017] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fa8f7940-0795-448f-8b76-c25517f7d548" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.180864] env[70614]: INFO networking_nsxv3.common.synchronization [None req-36d08ff9-cb40-4ca7-9fed-b6e671d21f4d None None] Enqueued Resource ID: 7ee30dfc-2fc6-472d-8d8f-8c2f3dd60a58 with Priority: HIGHEST for action port [ 644.182919] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ee30dfc-2fc6-472d-8d8f-8c2f3dd60a58 with Priority: HIGHEST for action port [ 644.186234] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ee30dfc-2fc6-472d-8d8f-8c2f3dd60a58 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.186234] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ee30dfc-2fc6-472d-8d8f-8c2f3dd60a58" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.186234] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ee30dfc-2fc6-472d-8d8f-8c2f3dd60a58" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.186234] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ee30dfc-2fc6-472d-8d8f-8c2f3dd60a58" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.186234] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ee30dfc-2fc6-472d-8d8f-8c2f3dd60a58',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.206413] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.206559] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.206629] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.207797] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.207797] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.207797] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ebcad34a-a932-4aaf-93de-b0493166d0cf already deleted. [ 644.207797] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ebcad34a-a932-4aaf-93de-b0493166d0cf" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.207797] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ebcad34a-a932-4aaf-93de-b0493166d0cf" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.207797] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ebcad34a-a932-4aaf-93de-b0493166d0cf" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.207797] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ebcad34a-a932-4aaf-93de-b0493166d0cf',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.694647] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7ee30dfc-2fc6-472d-8d8f-8c2f3dd60a58 [ 644.694647] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.694647] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.694647] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.694647] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.694647] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.694647] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7ee30dfc-2fc6-472d-8d8f-8c2f3dd60a58 already deleted. [ 644.694647] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ee30dfc-2fc6-472d-8d8f-8c2f3dd60a58" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.732356] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.732356] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.732356] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.733663] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.733663] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.734111] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ebcad34a-a932-4aaf-93de-b0493166d0cf already deleted. [ 644.734210] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ebcad34a-a932-4aaf-93de-b0493166d0cf" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.952732] env[70614]: INFO networking_nsxv3.common.synchronization [None req-3fa2069f-639c-44c7-9a18-f14718d561b0 None None] Enqueued Resource ID: af099263-202a-439b-ba76-0b26ed9ec38b with Priority: HIGHEST for action port [ 645.952732] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af099263-202a-439b-ba76-0b26ed9ec38b with Priority: HIGHEST for action port [ 645.953322] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-af099263-202a-439b-ba76-0b26ed9ec38b taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.953449] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-af099263-202a-439b-ba76-0b26ed9ec38b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.953520] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-af099263-202a-439b-ba76-0b26ed9ec38b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.953764] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-af099263-202a-439b-ba76-0b26ed9ec38b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.953850] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af099263-202a-439b-ba76-0b26ed9ec38b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.209146] env[70614]: INFO networking_nsxv3.common.synchronization [None req-882aef46-5024-435f-8ecb-21cacaf52ce2 None None] Enqueued Resource ID: 9626fb09-1292-4176-be85-5f577038ae7c with Priority: HIGHEST for action port [ 646.209146] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9626fb09-1292-4176-be85-5f577038ae7c with Priority: HIGHEST for action port [ 646.209146] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-9626fb09-1292-4176-be85-5f577038ae7c taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.209146] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9626fb09-1292-4176-be85-5f577038ae7c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.209146] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9626fb09-1292-4176-be85-5f577038ae7c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.209146] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9626fb09-1292-4176-be85-5f577038ae7c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.209146] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9626fb09-1292-4176-be85-5f577038ae7c',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.457792] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port af099263-202a-439b-ba76-0b26ed9ec38b [ 646.458049] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.458196] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.458265] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.458506] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.458660] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.462263] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:af099263-202a-439b-ba76-0b26ed9ec38b already deleted. [ 646.462438] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-af099263-202a-439b-ba76-0b26ed9ec38b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.712457] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9626fb09-1292-4176-be85-5f577038ae7c [ 646.712457] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.712635] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.712635] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.712824] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.712937] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.713681] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9626fb09-1292-4176-be85-5f577038ae7c already deleted. [ 646.713681] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9626fb09-1292-4176-be85-5f577038ae7c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.892343] env[70614]: INFO networking_nsxv3.common.synchronization [None req-8430c39a-9122-4a1a-a2fe-3317b05833dc None None] Enqueued Resource ID: cec0add2-da13-45c2-8062-1146b0b91055 with Priority: HIGHEST for action port [ 647.894209] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cec0add2-da13-45c2-8062-1146b0b91055 with Priority: HIGHEST for action port [ 647.894560] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-cec0add2-da13-45c2-8062-1146b0b91055 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.894680] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cec0add2-da13-45c2-8062-1146b0b91055" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.894753] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cec0add2-da13-45c2-8062-1146b0b91055" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.895103] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cec0add2-da13-45c2-8062-1146b0b91055" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.895589] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cec0add2-da13-45c2-8062-1146b0b91055',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.397323] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cec0add2-da13-45c2-8062-1146b0b91055 [ 648.397545] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.397685] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.397755] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.397971] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.398075] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.398169] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cec0add2-da13-45c2-8062-1146b0b91055 already deleted. [ 648.398246] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cec0add2-da13-45c2-8062-1146b0b91055" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.733672] env[70614]: INFO networking_nsxv3.common.synchronization [req-94f77f5f-fcdb-476f-b15e-f7ce6226dc5f req-24f890ee-caa4-48e6-af60-d68bcf8c445a tempest-DeleteServersAdminTestJSON-2096477242 tempest-DeleteServersAdminTestJSON-2096477242-project-member] Enqueued Resource ID: 63a56402-3dcf-44d4-b33d-a56ff531a12c with Priority: HIGHEST for action security_group_members [ 648.733672] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63a56402-3dcf-44d4-b33d-a56ff531a12c with Priority: HIGHEST for action security_group_members [ 648.733672] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-63a56402-3dcf-44d4-b33d-a56ff531a12c taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.733672] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63a56402-3dcf-44d4-b33d-a56ff531a12c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.734299] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63a56402-3dcf-44d4-b33d-a56ff531a12c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.734299] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63a56402-3dcf-44d4-b33d-a56ff531a12c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.734299] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.734578] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.734578] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.734749] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.735054] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.735054] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63a56402-3dcf-44d4-b33d-a56ff531a12c',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.238032] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.238332] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.238332] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.238427] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.238519] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.238721] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.238821] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.238884] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.239064] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.239144] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.239229] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63a56402-3dcf-44d4-b33d-a56ff531a12c already deleted. [ 649.239309] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63a56402-3dcf-44d4-b33d-a56ff531a12c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.689595] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-573 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.690333] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-573" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.690333] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-573" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.692804] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-573" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.692804] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.693124] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.693549] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.693549] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.693655] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.694133] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 649.694133] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 649.694133] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 649.694285] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 649.694393] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 649.694500] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 649.694636] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 649.721792] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 649.721792] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 649.721792] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 649.721792] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-573" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.721792] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-09c9066a-d30a-437d-8c04-4b18748ffe67 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.721792] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-09c9066a-d30a-437d-8c04-4b18748ffe67" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.721792] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-09c9066a-d30a-437d-8c04-4b18748ffe67" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.721792] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-09c9066a-d30a-437d-8c04-4b18748ffe67" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.721792] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09c9066a-d30a-437d-8c04-4b18748ffe67',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.003633] env[70614]: INFO networking_nsxv3.common.synchronization [None req-cca4058d-9f27-4cf0-b48c-1d9634a53b8f tempest-VolumesAssistedSnapshotsTest-988298436 tempest-VolumesAssistedSnapshotsTest-988298436-project-member] Enqueued Resource ID: e8c9194b-5e05-4207-a5ab-784203682b19 with Priority: HIGHEST for action security_group_rules [ 650.004248] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8c9194b-5e05-4207-a5ab-784203682b19 with Priority: HIGHEST for action security_group_rules [ 650.004604] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e8c9194b-5e05-4207-a5ab-784203682b19 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.004667] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e8c9194b-5e05-4207-a5ab-784203682b19" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.004756] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e8c9194b-5e05-4207-a5ab-784203682b19" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.005479] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e8c9194b-5e05-4207-a5ab-784203682b19" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.005586] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e8c9194b-5e05-4207-a5ab-784203682b19',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.101021] env[70614]: INFO networking_nsxv3.common.synchronization [None req-bf9e0f27-5b47-40f4-9120-0f71da49b3f0 None None] Enqueued Resource ID: 287eecc5-1daf-4562-ac01-27ece67ae2f1 with Priority: HIGHEST for action port [ 650.101287] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 287eecc5-1daf-4562-ac01-27ece67ae2f1 with Priority: HIGHEST for action port [ 650.101848] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-287eecc5-1daf-4562-ac01-27ece67ae2f1 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.102014] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-287eecc5-1daf-4562-ac01-27ece67ae2f1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.102049] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-287eecc5-1daf-4562-ac01-27ece67ae2f1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.102302] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-287eecc5-1daf-4562-ac01-27ece67ae2f1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.102387] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('287eecc5-1daf-4562-ac01-27ece67ae2f1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.211724] env[70614]: INFO networking_nsxv3.common.synchronization [None req-b148d1ff-3c95-4212-a425-31da61c43a40 tempest-VolumesAssistedSnapshotsTest-988298436 tempest-VolumesAssistedSnapshotsTest-988298436-project-member] Enqueued Resource ID: e8c9194b-5e05-4207-a5ab-784203682b19 with Priority: HIGHEST for action security_group_rules [ 650.212618] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8c9194b-5e05-4207-a5ab-784203682b19 with Priority: HIGHEST for action security_group_rules [ 650.213044] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e8c9194b-5e05-4207-a5ab-784203682b19 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.213044] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e8c9194b-5e05-4207-a5ab-784203682b19" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.226080] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.227330] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.227330] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.230136] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.230400] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.230592] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 09c9066a-d30a-437d-8c04-4b18748ffe67 not found, creating... [ 650.230899] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.231118] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.231211] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.231480] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.231623] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.232430] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.232430] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.232430] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.232945] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.232945] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.232945] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 09c9066a-d30a-437d-8c04-4b18748ffe67 is going to be created. [ 650.257409] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.257732] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.257778] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.258027] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.258271] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.258497] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-09c9066a-d30a-437d-8c04-4b18748ffe67" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.525817] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.525817] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.525949] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.526201] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.526316] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.526680] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e8c9194b-5e05-4207-a5ab-784203682b19 already deleted. [ 650.526680] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e8c9194b-5e05-4207-a5ab-784203682b19" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.526680] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e8c9194b-5e05-4207-a5ab-784203682b19" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.526868] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e8c9194b-5e05-4207-a5ab-784203682b19" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.526952] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e8c9194b-5e05-4207-a5ab-784203682b19',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.608997] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 287eecc5-1daf-4562-ac01-27ece67ae2f1 [ 650.609485] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.609485] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.609485] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.609654] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.609752] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.609847] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:287eecc5-1daf-4562-ac01-27ece67ae2f1 already deleted. [ 650.609930] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-287eecc5-1daf-4562-ac01-27ece67ae2f1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.819442] env[70614]: INFO networking_nsxv3.common.synchronization [req-b0d615b0-51d0-48df-8b22-0a2e5f684033 req-1b074a15-f396-43b2-83e5-6e5f965f2417 tempest-FloatingIPsAssociationTestJSON-514222769 tempest-FloatingIPsAssociationTestJSON-514222769-project-member] Enqueued Resource ID: f0060547-03fb-4d1a-ad8e-69519760b908 with Priority: HIGHEST for action security_group_members [ 650.820010] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0060547-03fb-4d1a-ad8e-69519760b908 with Priority: HIGHEST for action security_group_members [ 650.820342] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0060547-03fb-4d1a-ad8e-69519760b908 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.820462] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0060547-03fb-4d1a-ad8e-69519760b908" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.820528] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0060547-03fb-4d1a-ad8e-69519760b908" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.820774] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0060547-03fb-4d1a-ad8e-69519760b908" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.820921] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.821059] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.821122] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.821275] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.821381] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.821479] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0060547-03fb-4d1a-ad8e-69519760b908',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.039424] env[70614]: INFO networking_nsxv3.common.synchronization [None req-7bc67457-6604-48fc-b693-bc88aededb73 None None] Enqueued Resource ID: a985406a-e80f-497c-9be8-fff534aabe70 with Priority: HIGHEST for action port [ 651.039691] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a985406a-e80f-497c-9be8-fff534aabe70 with Priority: HIGHEST for action port [ 651.040273] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-a985406a-e80f-497c-9be8-fff534aabe70 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.040399] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a985406a-e80f-497c-9be8-fff534aabe70" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.040465] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a985406a-e80f-497c-9be8-fff534aabe70" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.040709] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a985406a-e80f-497c-9be8-fff534aabe70" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.040827] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a985406a-e80f-497c-9be8-fff534aabe70',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.047882] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.047882] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.047882] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.047882] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.047882] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.047882] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e8c9194b-5e05-4207-a5ab-784203682b19 already deleted. [ 651.047882] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e8c9194b-5e05-4207-a5ab-784203682b19" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.310151] env[70614]: INFO networking_nsxv3.common.synchronization [None req-d0407df3-d64b-41f0-8814-d8fe64b4d406 None None] Enqueued Resource ID: e381045c-2885-49a4-86d3-2a88146a39c1 with Priority: HIGHEST for action port [ 651.310443] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e381045c-2885-49a4-86d3-2a88146a39c1 with Priority: HIGHEST for action port [ 651.310982] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-e381045c-2885-49a4-86d3-2a88146a39c1 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.311433] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e381045c-2885-49a4-86d3-2a88146a39c1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.311433] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e381045c-2885-49a4-86d3-2a88146a39c1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.311433] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e381045c-2885-49a4-86d3-2a88146a39c1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.311575] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e381045c-2885-49a4-86d3-2a88146a39c1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.326899] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.326899] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.327093] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.327779] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.327779] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.327779] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.327779] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.327779] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.328116] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.328116] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.328116] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0060547-03fb-4d1a-ad8e-69519760b908 already deleted. [ 651.328257] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0060547-03fb-4d1a-ad8e-69519760b908" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.411146] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-45 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.411352] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-45" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.411528] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-45" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.411905] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-45" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.412217] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.412470] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.412602] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.412828] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.413015] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.413278] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 651.413434] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 651.413555] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 651.413667] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 651.413782] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 651.413892] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 651.414036] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 651.436113] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 651.436113] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 651.436113] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 651.436113] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-45" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.436113] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-383a9967-342b-40ac-88c9-ceb7102023de taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.436113] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-383a9967-342b-40ac-88c9-ceb7102023de" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.436113] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-383a9967-342b-40ac-88c9-ceb7102023de" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.436462] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-383a9967-342b-40ac-88c9-ceb7102023de" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.437279] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('383a9967-342b-40ac-88c9-ceb7102023de',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.541073] env[70614]: INFO networking_nsxv3.common.synchronization [req-94f77f5f-fcdb-476f-b15e-f7ce6226dc5f req-55a8541a-906a-4bda-86ec-98c7d17e0656 service nova] Enqueued Resource ID: 63a56402-3dcf-44d4-b33d-a56ff531a12c with Priority: HIGHEST for action security_group_rules [ 651.541272] env[70614]: INFO networking_nsxv3.common.synchronization [req-94f77f5f-fcdb-476f-b15e-f7ce6226dc5f req-55a8541a-906a-4bda-86ec-98c7d17e0656 service nova] Enqueued Resource ID: 63a56402-3dcf-44d4-b33d-a56ff531a12c with Priority: HIGHEST for action security_group_members [ 651.541413] env[70614]: INFO networking_nsxv3.common.synchronization [req-94f77f5f-fcdb-476f-b15e-f7ce6226dc5f req-55a8541a-906a-4bda-86ec-98c7d17e0656 service nova] Enqueued Resource ID: 09c9066a-d30a-437d-8c04-4b18748ffe67 with Priority: HIGHEST for action port [ 651.541638] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63a56402-3dcf-44d4-b33d-a56ff531a12c with Priority: HIGHEST for action security_group_rules [ 651.541764] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63a56402-3dcf-44d4-b33d-a56ff531a12c with Priority: HIGHEST for action security_group_members [ 651.541863] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09c9066a-d30a-437d-8c04-4b18748ffe67 with Priority: HIGHEST for action port [ 651.542397] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-63a56402-3dcf-44d4-b33d-a56ff531a12c taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.542528] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-63a56402-3dcf-44d4-b33d-a56ff531a12c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.542597] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-63a56402-3dcf-44d4-b33d-a56ff531a12c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.550068] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-63a56402-3dcf-44d4-b33d-a56ff531a12c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.550068] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('63a56402-3dcf-44d4-b33d-a56ff531a12c',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.550068] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-63a56402-3dcf-44d4-b33d-a56ff531a12c taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.550068] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63a56402-3dcf-44d4-b33d-a56ff531a12c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.550068] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63a56402-3dcf-44d4-b33d-a56ff531a12c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.550068] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63a56402-3dcf-44d4-b33d-a56ff531a12c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.550068] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.550068] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.550068] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.550068] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.550068] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.550068] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63a56402-3dcf-44d4-b33d-a56ff531a12c',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.550068] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-09c9066a-d30a-437d-8c04-4b18748ffe67 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.550068] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-09c9066a-d30a-437d-8c04-4b18748ffe67" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.550068] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-09c9066a-d30a-437d-8c04-4b18748ffe67" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.551028] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-09c9066a-d30a-437d-8c04-4b18748ffe67" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.551118] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09c9066a-d30a-437d-8c04-4b18748ffe67',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.553347] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a985406a-e80f-497c-9be8-fff534aabe70 [ 651.553347] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.553347] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.553347] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.553592] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.553712] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.553858] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a985406a-e80f-497c-9be8-fff534aabe70 already deleted. [ 651.553986] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a985406a-e80f-497c-9be8-fff534aabe70" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.815889] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e381045c-2885-49a4-86d3-2a88146a39c1 [ 651.815889] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.815889] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.815889] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.815889] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.815889] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.815889] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e381045c-2885-49a4-86d3-2a88146a39c1 already deleted. [ 651.815889] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e381045c-2885-49a4-86d3-2a88146a39c1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.940882] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.941389] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.941389] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.941651] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.942049] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.942271] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 383a9967-342b-40ac-88c9-ceb7102023de not found, creating... [ 651.943312] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.944177] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.944177] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.944295] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.944419] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.944734] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.944978] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.945045] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.945975] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.946057] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.946239] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 383a9967-342b-40ac-88c9-ceb7102023de is going to be created. [ 651.969508] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.969508] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.969508] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.969508] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.970333] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.970580] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-383a9967-342b-40ac-88c9-ceb7102023de" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.053106] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-63a56402-3dcf-44d4-b33d-a56ff531a12c taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.053313] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63a56402-3dcf-44d4-b33d-a56ff531a12c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.064229] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 09c9066a-d30a-437d-8c04-4b18748ffe67 with status ACTIVE [ 652.065263] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.065436] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.065436] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.065643] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.065692] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.065855] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.065970] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.066040] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.066202] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.066286] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.066470] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.066561] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.066618] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.067426] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.067426] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.067426] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 09c9066a-d30a-437d-8c04-4b18748ffe67 is going to be updated. [ 652.069659] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('63a56402-3dcf-44d4-b33d-a56ff531a12c',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.138994] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.139160] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.139231] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.139443] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.139576] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.139737] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-09c9066a-d30a-437d-8c04-4b18748ffe67" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.570777] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('63a56402-3dcf-44d4-b33d-a56ff531a12c',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.051250] env[70614]: INFO networking_nsxv3.common.synchronization [req-76429828-f786-4790-a1f3-816f20f8c9ff req-a1d5e4e8-c849-43e9-b0ed-83bdddd7e3ef tempest-DeleteServersTestJSON-1690139659 tempest-DeleteServersTestJSON-1690139659-project-member] Enqueued Resource ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f with Priority: HIGHEST for action security_group_members [ 653.051250] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f with Priority: HIGHEST for action security_group_members [ 653.051250] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.051250] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.051250] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.051250] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.051250] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.051250] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.051776] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.051950] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.052052] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.052151] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df8f20f5-6e92-4ac4-bdd2-05863ac4905f',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.073834] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.073995] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.074364] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.074612] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.074708] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.074815] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63a56402-3dcf-44d4-b33d-a56ff531a12c is going to be created. [ 653.104612] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.104783] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.104833] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.105062] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.105233] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.119171] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63a56402-3dcf-44d4-b33d-a56ff531a12c in Status: UNINITIALIZED for 2s [ 653.353272] env[70614]: INFO networking_nsxv3.common.synchronization [None req-41743b5c-e967-4d28-858c-1b6775667848 None None] Enqueued Resource ID: 25cf1b52-3d12-4bdb-a2e7-76529e5fc23e with Priority: HIGHEST for action port [ 653.353272] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25cf1b52-3d12-4bdb-a2e7-76529e5fc23e with Priority: HIGHEST for action port [ 653.353272] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-25cf1b52-3d12-4bdb-a2e7-76529e5fc23e taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.353272] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-25cf1b52-3d12-4bdb-a2e7-76529e5fc23e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.353272] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-25cf1b52-3d12-4bdb-a2e7-76529e5fc23e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.353272] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-25cf1b52-3d12-4bdb-a2e7-76529e5fc23e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.353631] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25cf1b52-3d12-4bdb-a2e7-76529e5fc23e',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.555246] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.555505] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.555568] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.555930] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.555930] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.556073] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.556289] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.556289] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.556399] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.556472] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.556559] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f already deleted. [ 653.556644] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.606131] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-707 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.606703] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-707" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.606703] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-707" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.608162] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-707" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.608162] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.608162] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.608162] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.608162] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.608162] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.608162] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 653.609425] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 653.609565] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 653.609686] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 653.609804] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 653.609913] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 653.610060] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 653.630969] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 653.630969] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 653.630969] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 653.630969] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-707" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.630969] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-28ceb0df-4867-4952-967d-426c80dbaac7 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.630969] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-28ceb0df-4867-4952-967d-426c80dbaac7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.630969] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-28ceb0df-4867-4952-967d-426c80dbaac7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.630969] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-28ceb0df-4867-4952-967d-426c80dbaac7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.630969] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('28ceb0df-4867-4952-967d-426c80dbaac7',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.637876] env[70614]: INFO networking_nsxv3.common.synchronization [req-b0d615b0-51d0-48df-8b22-0a2e5f684033 req-43f2abe0-9fc9-401b-9288-14f7af3546c6 service nova] Enqueued Resource ID: f0060547-03fb-4d1a-ad8e-69519760b908 with Priority: HIGHEST for action security_group_rules [ 653.639149] env[70614]: INFO networking_nsxv3.common.synchronization [req-b0d615b0-51d0-48df-8b22-0a2e5f684033 req-43f2abe0-9fc9-401b-9288-14f7af3546c6 service nova] Enqueued Resource ID: f0060547-03fb-4d1a-ad8e-69519760b908 with Priority: HIGHEST for action security_group_members [ 653.639300] env[70614]: INFO networking_nsxv3.common.synchronization [req-b0d615b0-51d0-48df-8b22-0a2e5f684033 req-43f2abe0-9fc9-401b-9288-14f7af3546c6 service nova] Enqueued Resource ID: 383a9967-342b-40ac-88c9-ceb7102023de with Priority: HIGHEST for action port [ 653.639553] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0060547-03fb-4d1a-ad8e-69519760b908 with Priority: HIGHEST for action security_group_rules [ 653.639664] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0060547-03fb-4d1a-ad8e-69519760b908 with Priority: HIGHEST for action security_group_members [ 653.639757] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 383a9967-342b-40ac-88c9-ceb7102023de with Priority: HIGHEST for action port [ 653.640349] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f0060547-03fb-4d1a-ad8e-69519760b908 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.640676] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f0060547-03fb-4d1a-ad8e-69519760b908" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.640676] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f0060547-03fb-4d1a-ad8e-69519760b908" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.640784] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f0060547-03fb-4d1a-ad8e-69519760b908" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.640857] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f0060547-03fb-4d1a-ad8e-69519760b908',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.644633] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0060547-03fb-4d1a-ad8e-69519760b908 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.644633] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0060547-03fb-4d1a-ad8e-69519760b908" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.644633] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0060547-03fb-4d1a-ad8e-69519760b908" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.644633] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0060547-03fb-4d1a-ad8e-69519760b908" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.644633] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.644633] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.644633] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.644633] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.644633] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.644633] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0060547-03fb-4d1a-ad8e-69519760b908',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.646840] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-383a9967-342b-40ac-88c9-ceb7102023de taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.646948] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-383a9967-342b-40ac-88c9-ceb7102023de" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.647076] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-383a9967-342b-40ac-88c9-ceb7102023de" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.647202] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-383a9967-342b-40ac-88c9-ceb7102023de" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.647286] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('383a9967-342b-40ac-88c9-ceb7102023de',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.860021] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 25cf1b52-3d12-4bdb-a2e7-76529e5fc23e [ 653.860021] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.860021] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.860021] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.860021] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.860021] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.860021] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:25cf1b52-3d12-4bdb-a2e7-76529e5fc23e already deleted. [ 653.860021] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-25cf1b52-3d12-4bdb-a2e7-76529e5fc23e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.138460] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.138726] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.138923] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.139050] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.139821] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.139821] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 28ceb0df-4867-4952-967d-426c80dbaac7 not found, creating... [ 654.139821] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.139821] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.140161] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.140161] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.140531] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.140858] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.141023] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.141144] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.141351] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.141497] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.141643] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 28ceb0df-4867-4952-967d-426c80dbaac7 is going to be created. [ 654.153157] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0060547-03fb-4d1a-ad8e-69519760b908 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.153157] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0060547-03fb-4d1a-ad8e-69519760b908" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.153157] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f0060547-03fb-4d1a-ad8e-69519760b908',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.153157] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 383a9967-342b-40ac-88c9-ceb7102023de with status ACTIVE [ 654.153157] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.153157] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.153157] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.153157] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.153157] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.153157] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.153157] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.153157] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.153157] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.153157] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.153801] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.153801] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.153801] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.155236] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.155359] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.156947] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 383a9967-342b-40ac-88c9-ceb7102023de is going to be updated. [ 654.164795] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.164795] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.164795] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.164795] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.164795] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.165126] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-28ceb0df-4867-4952-967d-426c80dbaac7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.194512] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.194665] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.194746] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.194976] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.195114] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.195443] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-383a9967-342b-40ac-88c9-ceb7102023de" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.531391] env[70614]: INFO networking_nsxv3.common.synchronization [None req-4536d493-207c-4bc6-b74a-44f0c57d0dec None None] Enqueued Resource ID: 25a853be-67e9-4971-adb0-a55694c83005 with Priority: HIGHEST for action port [ 654.531391] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25a853be-67e9-4971-adb0-a55694c83005 with Priority: HIGHEST for action port [ 654.531766] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-25a853be-67e9-4971-adb0-a55694c83005 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.533032] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-25a853be-67e9-4971-adb0-a55694c83005" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.533032] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-25a853be-67e9-4971-adb0-a55694c83005" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.533032] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-25a853be-67e9-4971-adb0-a55694c83005" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.533032] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25a853be-67e9-4971-adb0-a55694c83005',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.659181] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f0060547-03fb-4d1a-ad8e-69519760b908',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.036492] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 25a853be-67e9-4971-adb0-a55694c83005 [ 655.037602] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.037814] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.038892] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.039105] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.039341] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.039447] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:25a853be-67e9-4971-adb0-a55694c83005 already deleted. [ 655.039551] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-25a853be-67e9-4971-adb0-a55694c83005" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.130168] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63a56402-3dcf-44d4-b33d-a56ff531a12c in Status: SUCCESS [ 655.130168] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63a56402-3dcf-44d4-b33d-a56ff531a12c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.130168] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63a56402-3dcf-44d4-b33d-a56ff531a12c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.130168] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63a56402-3dcf-44d4-b33d-a56ff531a12c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.130168] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.130168] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.130168] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.130168] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.130168] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.130168] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63a56402-3dcf-44d4-b33d-a56ff531a12c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.130168] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('63a56402-3dcf-44d4-b33d-a56ff531a12c',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.162235] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.162398] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.162499] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.164340] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.164340] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.164340] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0060547-03fb-4d1a-ad8e-69519760b908 is going to be created. [ 655.186418] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.186649] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.186735] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.186950] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.187134] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.202871] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0060547-03fb-4d1a-ad8e-69519760b908 in Status: UNINITIALIZED for 2s [ 655.634485] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-63a56402-3dcf-44d4-b33d-a56ff531a12c taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.634485] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63a56402-3dcf-44d4-b33d-a56ff531a12c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.634485] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63a56402-3dcf-44d4-b33d-a56ff531a12c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.634639] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63a56402-3dcf-44d4-b33d-a56ff531a12c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.634668] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.635593] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.635593] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.635593] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.635593] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.635593] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63a56402-3dcf-44d4-b33d-a56ff531a12c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.635593] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-63a56402-3dcf-44d4-b33d-a56ff531a12c taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.635593] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63a56402-3dcf-44d4-b33d-a56ff531a12c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.635593] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63a56402-3dcf-44d4-b33d-a56ff531a12c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.635593] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63a56402-3dcf-44d4-b33d-a56ff531a12c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.635973] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.635973] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.635973] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.635973] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.636601] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.636601] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63a56402-3dcf-44d4-b33d-a56ff531a12c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.636601] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('63a56402-3dcf-44d4-b33d-a56ff531a12c',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.642123] env[70614]: INFO networking_nsxv3.common.synchronization [req-76429828-f786-4790-a1f3-816f20f8c9ff req-0af3d203-3dfb-472b-a7c3-c73442be81ed service nova] Enqueued Resource ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f with Priority: HIGHEST for action security_group_rules [ 655.642123] env[70614]: INFO networking_nsxv3.common.synchronization [req-76429828-f786-4790-a1f3-816f20f8c9ff req-0af3d203-3dfb-472b-a7c3-c73442be81ed service nova] Enqueued Resource ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f with Priority: HIGHEST for action security_group_members [ 655.642123] env[70614]: INFO networking_nsxv3.common.synchronization [req-76429828-f786-4790-a1f3-816f20f8c9ff req-0af3d203-3dfb-472b-a7c3-c73442be81ed service nova] Enqueued Resource ID: 28ceb0df-4867-4952-967d-426c80dbaac7 with Priority: HIGHEST for action port [ 655.642794] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f with Priority: HIGHEST for action security_group_rules [ 655.646320] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f with Priority: HIGHEST for action security_group_members [ 655.646320] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28ceb0df-4867-4952-967d-426c80dbaac7 with Priority: HIGHEST for action port [ 655.646320] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df8f20f5-6e92-4ac4-bdd2-05863ac4905f taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.646320] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.646320] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.646320] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.646320] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df8f20f5-6e92-4ac4-bdd2-05863ac4905f',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.646320] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.646320] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.646320] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.646320] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.646960] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.646960] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.647043] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.647140] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.647225] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.647331] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df8f20f5-6e92-4ac4-bdd2-05863ac4905f',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.648231] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-28ceb0df-4867-4952-967d-426c80dbaac7 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.648337] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-28ceb0df-4867-4952-967d-426c80dbaac7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.648402] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-28ceb0df-4867-4952-967d-426c80dbaac7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.648553] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-28ceb0df-4867-4952-967d-426c80dbaac7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.648620] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('28ceb0df-4867-4952-967d-426c80dbaac7',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.145573] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 63a56402-3dcf-44d4-b33d-a56ff531a12c: rpc.has_security_group_logging(os_id): False [ 656.152643] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.152643] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.152643] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('df8f20f5-6e92-4ac4-bdd2-05863ac4905f',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.157491] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 28ceb0df-4867-4952-967d-426c80dbaac7 with status ACTIVE [ 656.157491] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.157491] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.157491] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.157491] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.157491] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.157708] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.157708] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.157708] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.157998] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.157998] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.158543] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.158843] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.158843] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.158940] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.158972] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.161018] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 28ceb0df-4867-4952-967d-426c80dbaac7 is going to be updated. [ 656.175617] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.175770] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.176043] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.176105] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.176183] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.178193] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.178193] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.178193] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.178193] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.178193] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.178193] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.178193] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.178193] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.178193] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.178193] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.178193] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.178193] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.178193] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.178193] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.184012] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.184012] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 63a56402-3dcf-44d4-b33d-a56ff531a12c is going to be created. [ 656.199025] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.199025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.199025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.199025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.199025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.199025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-28ceb0df-4867-4952-967d-426c80dbaac7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.295125] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.295125] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.295125] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.295125] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.295125] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.311199] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63a56402-3dcf-44d4-b33d-a56ff531a12c in Status: IN_PROGRESS for 2s [ 656.657739] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('df8f20f5-6e92-4ac4-bdd2-05863ac4905f',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.741736] env[70614]: INFO networking_nsxv3.common.synchronization [None req-8907053a-a34b-487d-912a-178852b23d30 None None] Enqueued Resource ID: 9db39613-439e-47a1-b3ba-77a30978d39e with Priority: HIGHEST for action port [ 656.744143] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9db39613-439e-47a1-b3ba-77a30978d39e with Priority: HIGHEST for action port [ 656.746193] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-9db39613-439e-47a1-b3ba-77a30978d39e taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.746378] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9db39613-439e-47a1-b3ba-77a30978d39e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.746452] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9db39613-439e-47a1-b3ba-77a30978d39e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.746761] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9db39613-439e-47a1-b3ba-77a30978d39e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.746851] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9db39613-439e-47a1-b3ba-77a30978d39e',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.951335] env[70614]: INFO networking_nsxv3.common.synchronization [None req-7090ab6e-cc4d-4a8e-b1da-db393b80358c tempest-ServersWithSpecificFlavorTestJSON-1815410269 tempest-ServersWithSpecificFlavorTestJSON-1815410269-project-member] Enqueued Resource ID: ca9b1416-779b-4bc5-ae29-5117ebb9bc1a with Priority: HIGHEST for action security_group_rules [ 656.951480] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca9b1416-779b-4bc5-ae29-5117ebb9bc1a with Priority: HIGHEST for action security_group_rules [ 656.951848] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.951848] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.951848] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.953827] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.954127] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca9b1416-779b-4bc5-ae29-5117ebb9bc1a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.957871] env[70614]: INFO networking_nsxv3.common.synchronization [None req-479d7fe0-0015-402a-867a-fbd7086c6db4 None None] Enqueued Resource ID: 846c9188-4554-45fb-8e11-b74d6b854800 with Priority: HIGHEST for action port [ 656.957985] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 846c9188-4554-45fb-8e11-b74d6b854800 with Priority: HIGHEST for action port [ 656.959428] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-846c9188-4554-45fb-8e11-b74d6b854800 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.959627] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-846c9188-4554-45fb-8e11-b74d6b854800" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.959743] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-846c9188-4554-45fb-8e11-b74d6b854800" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.959974] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-846c9188-4554-45fb-8e11-b74d6b854800" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.960234] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('846c9188-4554-45fb-8e11-b74d6b854800',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.161656] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.162505] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.162613] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.162840] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.163035] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.163307] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f is going to be created. [ 657.190025] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.190025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.190187] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.190423] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.191186] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.207259] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f in Status: UNINITIALIZED for 2s [ 657.216531] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0060547-03fb-4d1a-ad8e-69519760b908 in Status: SUCCESS [ 657.216769] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0060547-03fb-4d1a-ad8e-69519760b908" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.217397] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0060547-03fb-4d1a-ad8e-69519760b908" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.217636] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0060547-03fb-4d1a-ad8e-69519760b908" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.217833] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.218033] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.218111] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.218276] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.218358] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.218446] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0060547-03fb-4d1a-ad8e-69519760b908" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.218915] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f0060547-03fb-4d1a-ad8e-69519760b908',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.250174] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9db39613-439e-47a1-b3ba-77a30978d39e [ 657.250418] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.250557] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.250628] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.251540] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.252025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.252118] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9db39613-439e-47a1-b3ba-77a30978d39e already deleted. [ 657.252193] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9db39613-439e-47a1-b3ba-77a30978d39e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.462682] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 846c9188-4554-45fb-8e11-b74d6b854800 [ 657.462829] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.462956] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.462956] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.463643] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.463643] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.463643] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:846c9188-4554-45fb-8e11-b74d6b854800 already deleted. [ 657.463643] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-846c9188-4554-45fb-8e11-b74d6b854800" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.481757] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.481961] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.482014] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.482211] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.483313] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.483313] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca9b1416-779b-4bc5-ae29-5117ebb9bc1a already deleted. [ 657.483313] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.543554] env[70614]: INFO networking_nsxv3.common.synchronization [None req-29bb1ed1-1473-42bb-a94c-17fae4f9d5cd tempest-ServersWithSpecificFlavorTestJSON-1815410269 tempest-ServersWithSpecificFlavorTestJSON-1815410269-project-member] Enqueued Resource ID: ca9b1416-779b-4bc5-ae29-5117ebb9bc1a with Priority: HIGHEST for action security_group_rules [ 657.545906] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca9b1416-779b-4bc5-ae29-5117ebb9bc1a with Priority: HIGHEST for action security_group_rules [ 657.545906] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.545906] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.545906] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.545906] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.545906] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca9b1416-779b-4bc5-ae29-5117ebb9bc1a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.723167] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0060547-03fb-4d1a-ad8e-69519760b908 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.723167] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0060547-03fb-4d1a-ad8e-69519760b908" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.723167] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0060547-03fb-4d1a-ad8e-69519760b908" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.723167] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0060547-03fb-4d1a-ad8e-69519760b908" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.723167] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.723167] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.723458] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.723458] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.723458] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.723536] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0060547-03fb-4d1a-ad8e-69519760b908" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.723664] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0060547-03fb-4d1a-ad8e-69519760b908 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.723839] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0060547-03fb-4d1a-ad8e-69519760b908" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.723839] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0060547-03fb-4d1a-ad8e-69519760b908" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.723924] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0060547-03fb-4d1a-ad8e-69519760b908" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.724071] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.724155] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.724210] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.724412] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.724471] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.724513] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0060547-03fb-4d1a-ad8e-69519760b908" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.724580] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f0060547-03fb-4d1a-ad8e-69519760b908',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.079296] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.079518] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.079518] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.079713] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.079795] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.081097] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca9b1416-779b-4bc5-ae29-5117ebb9bc1a already deleted. [ 658.081340] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.230296] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f0060547-03fb-4d1a-ad8e-69519760b908: rpc.has_security_group_logging(os_id): False [ 658.248428] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.252391] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.252391] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.252391] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.252391] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.252391] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.252391] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.252391] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.252391] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.252391] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.252391] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.252391] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.252391] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.252391] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.252391] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.253268] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.253268] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.253268] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.253268] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.253268] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.253268] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f0060547-03fb-4d1a-ad8e-69519760b908 is going to be created. [ 658.327299] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.327299] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.327299] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.327299] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.327299] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.331439] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63a56402-3dcf-44d4-b33d-a56ff531a12c in Status: SUCCESS [ 658.332436] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-63a56402-3dcf-44d4-b33d-a56ff531a12c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.342209] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f0060547-03fb-4d1a-ad8e-69519760b908 in Status: IN_PROGRESS for 2s [ 658.361172] env[70614]: INFO networking_nsxv3.common.synchronization [req-9f59e94e-6463-49eb-a142-4a60c6ae3b37 req-fde8e57e-8019-4dab-a617-2b107eed9c69 tempest-TenantUsagesTestJSON-1480594672 tempest-TenantUsagesTestJSON-1480594672-project-member] Enqueued Resource ID: 05ee2574-9125-4ff3-8197-e0eb7f0c45f2 with Priority: HIGHEST for action security_group_members [ 658.361172] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05ee2574-9125-4ff3-8197-e0eb7f0c45f2 with Priority: HIGHEST for action security_group_members [ 658.361172] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-05ee2574-9125-4ff3-8197-e0eb7f0c45f2 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.361172] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05ee2574-9125-4ff3-8197-e0eb7f0c45f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.361172] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05ee2574-9125-4ff3-8197-e0eb7f0c45f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.366585] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05ee2574-9125-4ff3-8197-e0eb7f0c45f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.366585] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.366585] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.366585] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.366585] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.366585] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.366585] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('05ee2574-9125-4ff3-8197-e0eb7f0c45f2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.868129] env[70614]: INFO networking_nsxv3.common.synchronization [None req-8e296378-110a-4023-bed7-31d1486d9d3c None None] Enqueued Resource ID: 2f0354b7-8d1d-43ba-859d-04847a2c0152 with Priority: HIGHEST for action port [ 658.868980] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f0354b7-8d1d-43ba-859d-04847a2c0152 with Priority: HIGHEST for action port [ 658.869068] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.869148] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.869249] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.869411] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.869497] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.870087] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.870087] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.870087] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.870662] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.870662] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.870662] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05ee2574-9125-4ff3-8197-e0eb7f0c45f2 already deleted. [ 658.870662] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05ee2574-9125-4ff3-8197-e0eb7f0c45f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.870867] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f0354b7-8d1d-43ba-859d-04847a2c0152 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.870867] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f0354b7-8d1d-43ba-859d-04847a2c0152" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.871031] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f0354b7-8d1d-43ba-859d-04847a2c0152" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.871225] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f0354b7-8d1d-43ba-859d-04847a2c0152" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.871328] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f0354b7-8d1d-43ba-859d-04847a2c0152',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.223028] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f in Status: SUCCESS [ 659.223291] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.223569] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.223728] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.223932] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.224073] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.224140] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.225424] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.226650] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.226650] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.226650] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('df8f20f5-6e92-4ac4-bdd2-05863ac4905f',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.354446] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-573 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.354789] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-573" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.354789] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-573" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.355703] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-573" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.356584] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.356816] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.356958] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.357263] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.357444] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.357682] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 659.357797] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 659.357906] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 659.358037] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 659.358148] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 659.358257] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 659.358411] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 659.374855] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2f0354b7-8d1d-43ba-859d-04847a2c0152 [ 659.375382] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.375382] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.375382] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.375636] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.375686] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.375796] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2f0354b7-8d1d-43ba-859d-04847a2c0152 already deleted. [ 659.375899] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f0354b7-8d1d-43ba-859d-04847a2c0152" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.405382] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 659.405559] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.047 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 659.405723] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 659.405899] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-573" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.406308] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-850ce523-2f25-4e31-9de6-c94b6424124c taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.406506] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-850ce523-2f25-4e31-9de6-c94b6424124c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.406650] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-850ce523-2f25-4e31-9de6-c94b6424124c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.407026] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-850ce523-2f25-4e31-9de6-c94b6424124c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.407177] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('850ce523-2f25-4e31-9de6-c94b6424124c',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.728912] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.729087] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.729158] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.729382] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.729542] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.729640] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.729701] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.729843] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.729926] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.730041] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.730178] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.730290] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.730350] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.730487] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.730616] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.730706] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.730762] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.730920] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.730996] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.731087] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.731172] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('df8f20f5-6e92-4ac4-bdd2-05863ac4905f',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.910108] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.910108] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.910108] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.910238] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.911225] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.911225] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 850ce523-2f25-4e31-9de6-c94b6424124c not found, creating... [ 659.911225] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.911225] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.911225] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.911503] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.911503] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.911713] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.911867] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.912255] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.914807] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.914807] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.914807] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 850ce523-2f25-4e31-9de6-c94b6424124c is going to be created. [ 659.938658] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.938985] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.939126] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.940529] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.940529] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.940529] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-850ce523-2f25-4e31-9de6-c94b6424124c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.066903] env[70614]: INFO networking_nsxv3.common.synchronization [None req-49b8ed0b-5ab1-4a43-add7-c48072c53a1e None None] Enqueued Resource ID: b197a82b-dc5c-46c9-bbf8-338ce7ce1f3d with Priority: HIGHEST for action port [ 660.066979] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b197a82b-dc5c-46c9-bbf8-338ce7ce1f3d with Priority: HIGHEST for action port [ 660.067633] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-b197a82b-dc5c-46c9-bbf8-338ce7ce1f3d taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.068350] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b197a82b-dc5c-46c9-bbf8-338ce7ce1f3d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.068350] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b197a82b-dc5c-46c9-bbf8-338ce7ce1f3d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.068350] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b197a82b-dc5c-46c9-bbf8-338ce7ce1f3d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.068350] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b197a82b-dc5c-46c9-bbf8-338ce7ce1f3d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.234533] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for df8f20f5-6e92-4ac4-bdd2-05863ac4905f: rpc.has_security_group_logging(os_id): False [ 660.255032] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.256199] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.256472] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.258018] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.258018] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.258018] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.258018] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.258018] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.258018] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.258018] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.258018] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.262856] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.262856] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.262856] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.262856] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.262856] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.262856] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.262856] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.262856] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.262856] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.262856] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f is going to be created. [ 660.344022] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.344022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.344022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.344022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.344022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.358786] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f0060547-03fb-4d1a-ad8e-69519760b908 in Status: SUCCESS [ 660.360917] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f0060547-03fb-4d1a-ad8e-69519760b908" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.360917] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f in Status: IN_PROGRESS for 2s [ 660.414338] env[70614]: INFO networking_nsxv3.common.synchronization [req-e2e92ca2-3b15-4bd3-9ee9-d0fbc39eafc0 req-b670a736-03b2-4d36-9b11-5e7338520237 tempest-AttachInterfacesTestJSON-1919943007 tempest-AttachInterfacesTestJSON-1919943007-project-member] Enqueued Resource ID: ebcad34a-a932-4aaf-93de-b0493166d0cf with Priority: HIGHEST for action security_group_members [ 660.416019] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebcad34a-a932-4aaf-93de-b0493166d0cf with Priority: HIGHEST for action security_group_members [ 660.416019] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebcad34a-a932-4aaf-93de-b0493166d0cf taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.416019] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebcad34a-a932-4aaf-93de-b0493166d0cf" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.416019] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebcad34a-a932-4aaf-93de-b0493166d0cf" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.416780] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebcad34a-a932-4aaf-93de-b0493166d0cf" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.417112] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.417414] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.419599] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.419599] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.419599] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.419599] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebcad34a-a932-4aaf-93de-b0493166d0cf',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.571293] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b197a82b-dc5c-46c9-bbf8-338ce7ce1f3d [ 660.571428] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.571567] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.571639] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.571851] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.571931] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.572044] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b197a82b-dc5c-46c9-bbf8-338ce7ce1f3d already deleted. [ 660.572110] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b197a82b-dc5c-46c9-bbf8-338ce7ce1f3d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.839491] env[70614]: INFO networking_nsxv3.common.synchronization [None req-ca7f8044-5b2f-49cd-a32f-009f4e46475a None None] Enqueued Resource ID: 30abc4d4-6380-41be-8574-ddafed077787 with Priority: HIGHEST for action port [ 660.839491] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30abc4d4-6380-41be-8574-ddafed077787 with Priority: HIGHEST for action port [ 660.839826] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-30abc4d4-6380-41be-8574-ddafed077787 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.839988] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-30abc4d4-6380-41be-8574-ddafed077787" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.840073] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-30abc4d4-6380-41be-8574-ddafed077787" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.840291] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-30abc4d4-6380-41be-8574-ddafed077787" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.840381] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30abc4d4-6380-41be-8574-ddafed077787',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.923302] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.923369] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.924702] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.924702] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.924702] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.924702] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.924702] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.924702] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.924973] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.924973] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.924973] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebcad34a-a932-4aaf-93de-b0493166d0cf already deleted. [ 660.925085] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebcad34a-a932-4aaf-93de-b0493166d0cf" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.345304] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 30abc4d4-6380-41be-8574-ddafed077787 [ 661.345304] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.345304] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.345304] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.345304] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.345304] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.345304] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:30abc4d4-6380-41be-8574-ddafed077787 already deleted. [ 661.345304] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-30abc4d4-6380-41be-8574-ddafed077787" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.789024] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-385 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.789024] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-385" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.789024] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-385" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.793025] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-385" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.793025] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.793025] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.793025] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.793025] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.793025] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.793025] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 661.793025] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 661.793025] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 661.793025] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 661.793025] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 661.793025] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 661.793025] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 661.813173] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 661.813430] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 661.813576] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 661.813842] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-385" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.814210] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-2b01a164-37ce-4784-bc0b-8e5b0b199535 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.814393] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-2b01a164-37ce-4784-bc0b-8e5b0b199535" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.814517] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-2b01a164-37ce-4784-bc0b-8e5b0b199535" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.814846] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-2b01a164-37ce-4784-bc0b-8e5b0b199535" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.814990] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b01a164-37ce-4784-bc0b-8e5b0b199535',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.915282] env[70614]: INFO networking_nsxv3.common.synchronization [req-9f59e94e-6463-49eb-a142-4a60c6ae3b37 req-c43c6842-4c77-4b8b-bc82-2a6223c76b52 service nova] Enqueued Resource ID: 05ee2574-9125-4ff3-8197-e0eb7f0c45f2 with Priority: HIGHEST for action security_group_rules [ 661.915282] env[70614]: INFO networking_nsxv3.common.synchronization [req-9f59e94e-6463-49eb-a142-4a60c6ae3b37 req-c43c6842-4c77-4b8b-bc82-2a6223c76b52 service nova] Enqueued Resource ID: 05ee2574-9125-4ff3-8197-e0eb7f0c45f2 with Priority: HIGHEST for action security_group_members [ 661.915282] env[70614]: INFO networking_nsxv3.common.synchronization [req-9f59e94e-6463-49eb-a142-4a60c6ae3b37 req-c43c6842-4c77-4b8b-bc82-2a6223c76b52 service nova] Enqueued Resource ID: 850ce523-2f25-4e31-9de6-c94b6424124c with Priority: HIGHEST for action port [ 661.915282] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05ee2574-9125-4ff3-8197-e0eb7f0c45f2 with Priority: HIGHEST for action security_group_rules [ 661.915282] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05ee2574-9125-4ff3-8197-e0eb7f0c45f2 with Priority: HIGHEST for action security_group_members [ 661.915282] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 850ce523-2f25-4e31-9de6-c94b6424124c with Priority: HIGHEST for action port [ 661.915282] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-05ee2574-9125-4ff3-8197-e0eb7f0c45f2 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.915797] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-05ee2574-9125-4ff3-8197-e0eb7f0c45f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.915839] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-05ee2574-9125-4ff3-8197-e0eb7f0c45f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.916192] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-05ee2574-9125-4ff3-8197-e0eb7f0c45f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.916192] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('05ee2574-9125-4ff3-8197-e0eb7f0c45f2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.919529] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-05ee2574-9125-4ff3-8197-e0eb7f0c45f2 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.919675] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05ee2574-9125-4ff3-8197-e0eb7f0c45f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.919857] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05ee2574-9125-4ff3-8197-e0eb7f0c45f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.920015] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05ee2574-9125-4ff3-8197-e0eb7f0c45f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.920518] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.920518] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.920518] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.920518] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.920724] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.920724] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('05ee2574-9125-4ff3-8197-e0eb7f0c45f2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.921662] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-850ce523-2f25-4e31-9de6-c94b6424124c taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.921799] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-850ce523-2f25-4e31-9de6-c94b6424124c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.921888] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-850ce523-2f25-4e31-9de6-c94b6424124c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.923148] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-850ce523-2f25-4e31-9de6-c94b6424124c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.923148] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('850ce523-2f25-4e31-9de6-c94b6424124c',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.320662] env[70614]: INFO networking_nsxv3.common.synchronization [req-2ebd2fd0-8c31-4c2c-92ab-e067573abfe4 req-e6836cde-76dd-4580-b8b8-bb8bd0e4d955 tempest-ImagesOneServerTestJSON-416271023 tempest-ImagesOneServerTestJSON-416271023-project-member] Enqueued Resource ID: 03fa4ca9-532b-43b0-bd53-de11eea0a016 with Priority: HIGHEST for action security_group_members [ 662.325756] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.325756] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.325756] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.325756] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.325756] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.325756] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 2b01a164-37ce-4784-bc0b-8e5b0b199535 not found, creating... [ 662.325756] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.325756] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.325756] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.325756] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.325756] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.326343] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.326343] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.326343] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.328392] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.328392] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.328392] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 2b01a164-37ce-4784-bc0b-8e5b0b199535 is going to be created. [ 662.329485] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03fa4ca9-532b-43b0-bd53-de11eea0a016 with Priority: HIGHEST for action security_group_members [ 662.330448] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-03fa4ca9-532b-43b0-bd53-de11eea0a016 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.330448] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03fa4ca9-532b-43b0-bd53-de11eea0a016" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.330448] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03fa4ca9-532b-43b0-bd53-de11eea0a016" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.330801] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03fa4ca9-532b-43b0-bd53-de11eea0a016" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.330801] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.330801] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.330801] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.330972] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.331019] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.331972] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('03fa4ca9-532b-43b0-bd53-de11eea0a016',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.354435] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.354527] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.354843] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.354912] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.355212] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.355439] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-2b01a164-37ce-4784-bc0b-8e5b0b199535" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.378546] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f in Status: SUCCESS [ 662.378783] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.423974] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('05ee2574-9125-4ff3-8197-e0eb7f0c45f2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.425479] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-05ee2574-9125-4ff3-8197-e0eb7f0c45f2 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.426017] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05ee2574-9125-4ff3-8197-e0eb7f0c45f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.433218] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 850ce523-2f25-4e31-9de6-c94b6424124c with status ACTIVE [ 662.433218] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.433218] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.433218] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.433218] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.433218] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.433218] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.433218] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.433218] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.433218] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.433218] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.433218] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.433218] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.433218] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.433218] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.433218] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.433218] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 850ce523-2f25-4e31-9de6-c94b6424124c is going to be updated. [ 662.472213] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.472355] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.472709] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.472709] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.472925] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.472968] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-850ce523-2f25-4e31-9de6-c94b6424124c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.834711] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.834711] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.834711] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.835222] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.835222] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.835222] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.835332] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.835332] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.835703] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.835703] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.835703] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03fa4ca9-532b-43b0-bd53-de11eea0a016 already deleted. [ 662.835703] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03fa4ca9-532b-43b0-bd53-de11eea0a016" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.929762] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('05ee2574-9125-4ff3-8197-e0eb7f0c45f2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.432921] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-500 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.433165] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-500" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.433259] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-500" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.433710] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-500" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.434109] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.434109] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.436886] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.437470] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.437890] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.438218] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 663.438470] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 663.438646] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 663.438773] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 663.439107] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 663.439107] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 663.439240] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 663.441889] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.442090] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.442361] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.442604] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.442725] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.442843] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05ee2574-9125-4ff3-8197-e0eb7f0c45f2 is going to be created. [ 663.468028] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 663.468028] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 663.468028] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 663.468509] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-500" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.468851] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-b00602b9-d3f3-473a-896c-27cf6be41b63 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.469182] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-b00602b9-d3f3-473a-896c-27cf6be41b63" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.469182] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-b00602b9-d3f3-473a-896c-27cf6be41b63" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.469554] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-b00602b9-d3f3-473a-896c-27cf6be41b63" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.469716] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b00602b9-d3f3-473a-896c-27cf6be41b63',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.473512] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.475063] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.475063] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.475063] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.475063] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.488614] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05ee2574-9125-4ff3-8197-e0eb7f0c45f2 in Status: UNINITIALIZED for 2s [ 663.529132] env[70614]: INFO networking_nsxv3.common.synchronization [None req-3d0a5c99-7e53-436f-8d99-0cf4611bdd64 None None] Enqueued Resource ID: 7664bc10-5d06-4796-a6f4-c7e19ef76463 with Priority: HIGHEST for action port [ 663.529132] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7664bc10-5d06-4796-a6f4-c7e19ef76463 with Priority: HIGHEST for action port [ 663.530903] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-7664bc10-5d06-4796-a6f4-c7e19ef76463 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.530903] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7664bc10-5d06-4796-a6f4-c7e19ef76463" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.530903] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7664bc10-5d06-4796-a6f4-c7e19ef76463" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.531138] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7664bc10-5d06-4796-a6f4-c7e19ef76463" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.531172] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7664bc10-5d06-4796-a6f4-c7e19ef76463',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.757193] env[70614]: INFO networking_nsxv3.common.synchronization [req-e2e92ca2-3b15-4bd3-9ee9-d0fbc39eafc0 req-1c319707-1fa2-4fd7-9c18-fefb7f47e25d service nova] Enqueued Resource ID: ebcad34a-a932-4aaf-93de-b0493166d0cf with Priority: HIGHEST for action security_group_rules [ 663.757379] env[70614]: INFO networking_nsxv3.common.synchronization [req-e2e92ca2-3b15-4bd3-9ee9-d0fbc39eafc0 req-1c319707-1fa2-4fd7-9c18-fefb7f47e25d service nova] Enqueued Resource ID: ebcad34a-a932-4aaf-93de-b0493166d0cf with Priority: HIGHEST for action security_group_members [ 663.757379] env[70614]: INFO networking_nsxv3.common.synchronization [req-e2e92ca2-3b15-4bd3-9ee9-d0fbc39eafc0 req-1c319707-1fa2-4fd7-9c18-fefb7f47e25d service nova] Enqueued Resource ID: 2b01a164-37ce-4784-bc0b-8e5b0b199535 with Priority: HIGHEST for action port [ 663.758018] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebcad34a-a932-4aaf-93de-b0493166d0cf with Priority: HIGHEST for action security_group_rules [ 663.758018] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebcad34a-a932-4aaf-93de-b0493166d0cf with Priority: HIGHEST for action security_group_members [ 663.758018] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b01a164-37ce-4784-bc0b-8e5b0b199535 with Priority: HIGHEST for action port [ 663.758366] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ebcad34a-a932-4aaf-93de-b0493166d0cf taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.759817] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ebcad34a-a932-4aaf-93de-b0493166d0cf" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.759817] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ebcad34a-a932-4aaf-93de-b0493166d0cf" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.759817] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ebcad34a-a932-4aaf-93de-b0493166d0cf" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.759817] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ebcad34a-a932-4aaf-93de-b0493166d0cf',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.759993] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebcad34a-a932-4aaf-93de-b0493166d0cf taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.760053] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebcad34a-a932-4aaf-93de-b0493166d0cf" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.760098] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebcad34a-a932-4aaf-93de-b0493166d0cf" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.760260] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebcad34a-a932-4aaf-93de-b0493166d0cf" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.760689] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.760802] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.760865] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.761022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.761109] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.761202] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebcad34a-a932-4aaf-93de-b0493166d0cf',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.762680] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b01a164-37ce-4784-bc0b-8e5b0b199535 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.762680] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b01a164-37ce-4784-bc0b-8e5b0b199535" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.762680] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b01a164-37ce-4784-bc0b-8e5b0b199535" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.763308] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b01a164-37ce-4784-bc0b-8e5b0b199535" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.763354] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b01a164-37ce-4784-bc0b-8e5b0b199535',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.972236] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.972728] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.972728] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.972875] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.973046] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.973211] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port b00602b9-d3f3-473a-896c-27cf6be41b63 not found, creating... [ 663.973471] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.973622] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.973769] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.973953] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.974117] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.974543] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.974653] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.974734] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.974987] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.975518] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.975694] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: b00602b9-d3f3-473a-896c-27cf6be41b63 is going to be created. [ 663.998507] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.998745] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.998886] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.999178] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.999436] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.999824] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-b00602b9-d3f3-473a-896c-27cf6be41b63" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.034168] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7664bc10-5d06-4796-a6f4-c7e19ef76463 [ 664.034480] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.034707] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.034707] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.035232] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.035232] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.035232] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7664bc10-5d06-4796-a6f4-c7e19ef76463 already deleted. [ 664.035232] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7664bc10-5d06-4796-a6f4-c7e19ef76463" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.269489] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2b01a164-37ce-4784-bc0b-8e5b0b199535 with status ACTIVE [ 664.269756] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.269921] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.270020] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.270264] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.270618] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.270686] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.270983] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.270983] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.273523] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.273523] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.273523] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.273523] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.273523] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.273523] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.273523] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.273523] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2b01a164-37ce-4784-bc0b-8e5b0b199535 is going to be updated. [ 664.274504] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebcad34a-a932-4aaf-93de-b0493166d0cf taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.274597] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebcad34a-a932-4aaf-93de-b0493166d0cf" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.274770] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ebcad34a-a932-4aaf-93de-b0493166d0cf',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.298664] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.299460] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.299460] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.299460] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.299460] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.299460] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b01a164-37ce-4784-bc0b-8e5b0b199535" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.770245] env[70614]: INFO networking_nsxv3.common.synchronization [req-a400771b-c5d9-4b3b-b385-f09f4b6358bc req-52b38b4f-98fa-417f-9c29-e5cfc1351371 tempest-VolumesAssistedSnapshotsTest-988298436 tempest-VolumesAssistedSnapshotsTest-988298436-project-member] Enqueued Resource ID: e8c9194b-5e05-4207-a5ab-784203682b19 with Priority: HIGHEST for action security_group_members [ 664.771031] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8c9194b-5e05-4207-a5ab-784203682b19 with Priority: HIGHEST for action security_group_members [ 664.771768] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8c9194b-5e05-4207-a5ab-784203682b19 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.772444] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8c9194b-5e05-4207-a5ab-784203682b19" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.772444] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8c9194b-5e05-4207-a5ab-784203682b19" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.772444] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8c9194b-5e05-4207-a5ab-784203682b19" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.772444] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.772699] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.772699] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.772766] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.772824] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.772915] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e8c9194b-5e05-4207-a5ab-784203682b19',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.777030] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ebcad34a-a932-4aaf-93de-b0493166d0cf',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.276972] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.276972] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.276972] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.276972] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.278360] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.278607] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.278719] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.278816] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.278970] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.279420] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.279420] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8c9194b-5e05-4207-a5ab-784203682b19 already deleted. [ 665.279420] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8c9194b-5e05-4207-a5ab-784203682b19" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.279609] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.279664] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.281731] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.281731] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.281731] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.281731] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebcad34a-a932-4aaf-93de-b0493166d0cf is going to be created. [ 665.308667] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.308789] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.308832] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.309558] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.309558] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.321313] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebcad34a-a932-4aaf-93de-b0493166d0cf in Status: UNINITIALIZED for 2s [ 665.324687] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-752 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.324891] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-752" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.324987] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-752" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.325372] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-752" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.325683] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.326038] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.326038] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.326263] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.326451] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.326679] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 665.326821] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 665.326970] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 665.327114] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 665.327382] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 665.327382] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 665.327484] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 665.349127] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 665.349127] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 665.349310] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 665.349419] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-752" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.349965] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-2ec8ae2d-bfc9-458c-8e6f-cedd2f20df7b taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.350176] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-2ec8ae2d-bfc9-458c-8e6f-cedd2f20df7b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.350176] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-2ec8ae2d-bfc9-458c-8e6f-cedd2f20df7b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.350553] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-2ec8ae2d-bfc9-458c-8e6f-cedd2f20df7b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.350633] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ec8ae2d-bfc9-458c-8e6f-cedd2f20df7b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.500500] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05ee2574-9125-4ff3-8197-e0eb7f0c45f2 in Status: SUCCESS [ 665.500571] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05ee2574-9125-4ff3-8197-e0eb7f0c45f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.500780] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05ee2574-9125-4ff3-8197-e0eb7f0c45f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.501236] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05ee2574-9125-4ff3-8197-e0eb7f0c45f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.501391] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.501631] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.501631] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.501631] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.501723] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.501803] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05ee2574-9125-4ff3-8197-e0eb7f0c45f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.501875] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('05ee2574-9125-4ff3-8197-e0eb7f0c45f2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.590290] env[70614]: INFO networking_nsxv3.common.synchronization [req-2ebd2fd0-8c31-4c2c-92ab-e067573abfe4 req-bed31797-2848-4753-aca4-6b609be64985 service nova] Enqueued Resource ID: 03fa4ca9-532b-43b0-bd53-de11eea0a016 with Priority: HIGHEST for action security_group_rules [ 665.590517] env[70614]: INFO networking_nsxv3.common.synchronization [req-2ebd2fd0-8c31-4c2c-92ab-e067573abfe4 req-bed31797-2848-4753-aca4-6b609be64985 service nova] Enqueued Resource ID: 03fa4ca9-532b-43b0-bd53-de11eea0a016 with Priority: HIGHEST for action security_group_members [ 665.590703] env[70614]: INFO networking_nsxv3.common.synchronization [req-2ebd2fd0-8c31-4c2c-92ab-e067573abfe4 req-bed31797-2848-4753-aca4-6b609be64985 service nova] Enqueued Resource ID: b00602b9-d3f3-473a-896c-27cf6be41b63 with Priority: HIGHEST for action port [ 665.590939] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03fa4ca9-532b-43b0-bd53-de11eea0a016 with Priority: HIGHEST for action security_group_rules [ 665.591400] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03fa4ca9-532b-43b0-bd53-de11eea0a016 with Priority: HIGHEST for action security_group_members [ 665.591400] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b00602b9-d3f3-473a-896c-27cf6be41b63 with Priority: HIGHEST for action port [ 665.593775] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-03fa4ca9-532b-43b0-bd53-de11eea0a016 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.594081] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-03fa4ca9-532b-43b0-bd53-de11eea0a016" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.594244] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-03fa4ca9-532b-43b0-bd53-de11eea0a016" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.595055] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-03fa4ca9-532b-43b0-bd53-de11eea0a016" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.595236] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('03fa4ca9-532b-43b0-bd53-de11eea0a016',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.596426] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-03fa4ca9-532b-43b0-bd53-de11eea0a016 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.596426] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03fa4ca9-532b-43b0-bd53-de11eea0a016" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.596426] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03fa4ca9-532b-43b0-bd53-de11eea0a016" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.596614] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03fa4ca9-532b-43b0-bd53-de11eea0a016" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.597262] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.597399] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.597773] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.597773] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.597773] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.598493] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('03fa4ca9-532b-43b0-bd53-de11eea0a016',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.602417] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-b00602b9-d3f3-473a-896c-27cf6be41b63 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.602417] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b00602b9-d3f3-473a-896c-27cf6be41b63" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.602417] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b00602b9-d3f3-473a-896c-27cf6be41b63" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.602417] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b00602b9-d3f3-473a-896c-27cf6be41b63" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.602417] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b00602b9-d3f3-473a-896c-27cf6be41b63',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.855298] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.855537] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.855696] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.856025] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.856199] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.856385] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 2ec8ae2d-bfc9-458c-8e6f-cedd2f20df7b not found, creating... [ 665.856694] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.856881] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.856995] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.857254] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.857509] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.857755] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.857914] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.862143] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.862143] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.862143] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.862143] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 2ec8ae2d-bfc9-458c-8e6f-cedd2f20df7b is going to be created. [ 665.890602] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.890602] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.890602] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.890602] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.890602] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.890602] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-2ec8ae2d-bfc9-458c-8e6f-cedd2f20df7b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.006190] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-05ee2574-9125-4ff3-8197-e0eb7f0c45f2 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.006190] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05ee2574-9125-4ff3-8197-e0eb7f0c45f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.006190] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05ee2574-9125-4ff3-8197-e0eb7f0c45f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.006577] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05ee2574-9125-4ff3-8197-e0eb7f0c45f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.006693] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.006836] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.007046] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.007046] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.007160] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.007219] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05ee2574-9125-4ff3-8197-e0eb7f0c45f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.007372] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-05ee2574-9125-4ff3-8197-e0eb7f0c45f2 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.007466] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05ee2574-9125-4ff3-8197-e0eb7f0c45f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.007534] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05ee2574-9125-4ff3-8197-e0eb7f0c45f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.007822] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05ee2574-9125-4ff3-8197-e0eb7f0c45f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.007915] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.012029] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.012029] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.012029] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.012029] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.012029] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05ee2574-9125-4ff3-8197-e0eb7f0c45f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.012029] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('05ee2574-9125-4ff3-8197-e0eb7f0c45f2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.020537] env[70614]: INFO networking_nsxv3.common.synchronization [None req-18afaadb-a634-4bfb-97b2-c525cf9d1b61 None None] Enqueued Resource ID: ba2ab689-d608-4f0e-a041-302354e0ad75 with Priority: HIGHEST for action port [ 666.020783] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba2ab689-d608-4f0e-a041-302354e0ad75 with Priority: HIGHEST for action port [ 666.021383] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-ba2ab689-d608-4f0e-a041-302354e0ad75 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.021524] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ba2ab689-d608-4f0e-a041-302354e0ad75" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.021601] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ba2ab689-d608-4f0e-a041-302354e0ad75" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.023017] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ba2ab689-d608-4f0e-a041-302354e0ad75" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.023017] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba2ab689-d608-4f0e-a041-302354e0ad75',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.101258] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('03fa4ca9-532b-43b0-bd53-de11eea0a016',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.103708] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-03fa4ca9-532b-43b0-bd53-de11eea0a016 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.104570] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03fa4ca9-532b-43b0-bd53-de11eea0a016" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.105090] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b00602b9-d3f3-473a-896c-27cf6be41b63 with status ACTIVE [ 666.105246] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.105374] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.105447] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.105671] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.105734] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.107155] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.107312] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.107386] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.107705] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.107787] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.107977] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.108085] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.108144] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.108373] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.108501] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.108551] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b00602b9-d3f3-473a-896c-27cf6be41b63 is going to be updated. [ 666.140700] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.140840] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.141033] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.141359] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.141359] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.141553] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b00602b9-d3f3-473a-896c-27cf6be41b63" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.515825] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 05ee2574-9125-4ff3-8197-e0eb7f0c45f2: rpc.has_security_group_logging(os_id): False [ 666.526924] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ba2ab689-d608-4f0e-a041-302354e0ad75 [ 666.527800] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.528407] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.528407] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.529570] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.529570] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.529570] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ba2ab689-d608-4f0e-a041-302354e0ad75 already deleted. [ 666.529570] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ba2ab689-d608-4f0e-a041-302354e0ad75" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.539172] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.539172] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.539172] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.539172] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.539172] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.539172] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.539172] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.539172] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.539172] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.539765] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.539765] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.540463] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.540463] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.540463] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.540463] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.540849] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.540997] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.541137] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.541423] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.541556] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.541682] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 05ee2574-9125-4ff3-8197-e0eb7f0c45f2 is going to be created. [ 666.607043] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('03fa4ca9-532b-43b0-bd53-de11eea0a016',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.626968] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.626968] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.626968] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.627352] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.628287] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.644096] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 05ee2574-9125-4ff3-8197-e0eb7f0c45f2 in Status: IN_PROGRESS for 2s [ 667.110942] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.111174] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.111236] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.111564] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.111564] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.111756] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03fa4ca9-532b-43b0-bd53-de11eea0a016 is going to be created. [ 667.140450] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.140450] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.140450] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.140450] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.140450] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.152741] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03fa4ca9-532b-43b0-bd53-de11eea0a016 in Status: UNINITIALIZED for 2s [ 667.331720] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebcad34a-a932-4aaf-93de-b0493166d0cf in Status: SUCCESS [ 667.331992] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebcad34a-a932-4aaf-93de-b0493166d0cf" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.332218] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebcad34a-a932-4aaf-93de-b0493166d0cf" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.332440] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebcad34a-a932-4aaf-93de-b0493166d0cf" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.332666] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.332815] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.332904] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.333136] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.333223] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.333335] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebcad34a-a932-4aaf-93de-b0493166d0cf" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.333431] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ebcad34a-a932-4aaf-93de-b0493166d0cf',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.480431] env[70614]: INFO networking_nsxv3.common.synchronization [None req-ae3943fc-cea0-4f2c-b41b-3ecb4077a50c None None] Enqueued Resource ID: b88fd7f1-81d6-413a-b794-cb1cd819758f with Priority: HIGHEST for action port [ 667.480997] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b88fd7f1-81d6-413a-b794-cb1cd819758f with Priority: HIGHEST for action port [ 667.482814] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-b88fd7f1-81d6-413a-b794-cb1cd819758f taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.483206] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b88fd7f1-81d6-413a-b794-cb1cd819758f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.483206] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b88fd7f1-81d6-413a-b794-cb1cd819758f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.483506] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b88fd7f1-81d6-413a-b794-cb1cd819758f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.483570] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b88fd7f1-81d6-413a-b794-cb1cd819758f',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.508877] env[70614]: INFO networking_nsxv3.common.synchronization [req-a400771b-c5d9-4b3b-b385-f09f4b6358bc req-8e8db09b-4a75-4055-a4f5-cd342bc48da0 service nova] Enqueued Resource ID: e8c9194b-5e05-4207-a5ab-784203682b19 with Priority: HIGHEST for action security_group_rules [ 667.509637] env[70614]: INFO networking_nsxv3.common.synchronization [req-a400771b-c5d9-4b3b-b385-f09f4b6358bc req-8e8db09b-4a75-4055-a4f5-cd342bc48da0 service nova] Enqueued Resource ID: e8c9194b-5e05-4207-a5ab-784203682b19 with Priority: HIGHEST for action security_group_members [ 667.509828] env[70614]: INFO networking_nsxv3.common.synchronization [req-a400771b-c5d9-4b3b-b385-f09f4b6358bc req-8e8db09b-4a75-4055-a4f5-cd342bc48da0 service nova] Enqueued Resource ID: 2ec8ae2d-bfc9-458c-8e6f-cedd2f20df7b with Priority: HIGHEST for action port [ 667.510731] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8c9194b-5e05-4207-a5ab-784203682b19 with Priority: HIGHEST for action security_group_rules [ 667.510779] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8c9194b-5e05-4207-a5ab-784203682b19 with Priority: HIGHEST for action security_group_members [ 667.511211] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ec8ae2d-bfc9-458c-8e6f-cedd2f20df7b with Priority: HIGHEST for action port [ 667.511348] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e8c9194b-5e05-4207-a5ab-784203682b19 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.511412] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e8c9194b-5e05-4207-a5ab-784203682b19" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.511477] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e8c9194b-5e05-4207-a5ab-784203682b19" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.511725] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e8c9194b-5e05-4207-a5ab-784203682b19" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.511866] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e8c9194b-5e05-4207-a5ab-784203682b19',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.514106] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8c9194b-5e05-4207-a5ab-784203682b19 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.514106] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8c9194b-5e05-4207-a5ab-784203682b19" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.514106] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8c9194b-5e05-4207-a5ab-784203682b19" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.514106] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8c9194b-5e05-4207-a5ab-784203682b19" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.514106] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.514106] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.514106] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.514978] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.514978] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.514978] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e8c9194b-5e05-4207-a5ab-784203682b19',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.517055] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-2ec8ae2d-bfc9-458c-8e6f-cedd2f20df7b taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.517055] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2ec8ae2d-bfc9-458c-8e6f-cedd2f20df7b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.517055] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2ec8ae2d-bfc9-458c-8e6f-cedd2f20df7b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.517055] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2ec8ae2d-bfc9-458c-8e6f-cedd2f20df7b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.517055] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ec8ae2d-bfc9-458c-8e6f-cedd2f20df7b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.836481] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ebcad34a-a932-4aaf-93de-b0493166d0cf',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.986931] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b88fd7f1-81d6-413a-b794-cb1cd819758f [ 667.987282] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.987431] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.987499] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.987742] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.987870] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.987994] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b88fd7f1-81d6-413a-b794-cb1cd819758f already deleted. [ 667.988098] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b88fd7f1-81d6-413a-b794-cb1cd819758f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.019665] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8c9194b-5e05-4207-a5ab-784203682b19 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.019802] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8c9194b-5e05-4207-a5ab-784203682b19" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.020021] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e8c9194b-5e05-4207-a5ab-784203682b19',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.020969] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2ec8ae2d-bfc9-458c-8e6f-cedd2f20df7b with status ACTIVE [ 668.021154] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.021275] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.021339] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.021544] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.021630] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.021796] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.021888] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.021984] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.022106] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.022177] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.022351] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.022437] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.022494] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.023568] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.023701] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.023800] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2ec8ae2d-bfc9-458c-8e6f-cedd2f20df7b is going to be updated. [ 668.055209] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.055406] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.055479] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.055697] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.055827] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.056012] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2ec8ae2d-bfc9-458c-8e6f-cedd2f20df7b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.340080] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ebcad34a-a932-4aaf-93de-b0493166d0cf: rpc.has_security_group_logging(os_id): False [ 668.360335] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.360488] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.360547] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.360973] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.360973] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.361114] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.361226] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.361294] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.361439] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.361521] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.361608] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ebcad34a-a932-4aaf-93de-b0493166d0cf is going to be created. [ 668.438200] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.438200] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.438200] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.438200] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.438200] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.449781] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ebcad34a-a932-4aaf-93de-b0493166d0cf in Status: IN_PROGRESS for 2s [ 668.527912] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e8c9194b-5e05-4207-a5ab-784203682b19',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.657797] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 05ee2574-9125-4ff3-8197-e0eb7f0c45f2 in Status: SUCCESS [ 668.657797] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-05ee2574-9125-4ff3-8197-e0eb7f0c45f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.035083] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.035083] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.035083] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.035083] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.035083] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.035083] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8c9194b-5e05-4207-a5ab-784203682b19 is going to be created. [ 669.070844] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.071083] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.071965] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.071965] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.071965] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.085942] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8c9194b-5e05-4207-a5ab-784203682b19 in Status: UNINITIALIZED for 2s [ 669.094586] env[70614]: INFO networking_nsxv3.common.synchronization [None req-400bfef4-2b83-45a7-baaf-70b353730370 None None] Enqueued Resource ID: 33765c32-9ffc-4499-aa5d-de60b703dbf5 with Priority: HIGHEST for action port [ 669.095156] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33765c32-9ffc-4499-aa5d-de60b703dbf5 with Priority: HIGHEST for action port [ 669.095469] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-33765c32-9ffc-4499-aa5d-de60b703dbf5 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.095618] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-33765c32-9ffc-4499-aa5d-de60b703dbf5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.096165] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-33765c32-9ffc-4499-aa5d-de60b703dbf5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.096165] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-33765c32-9ffc-4499-aa5d-de60b703dbf5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.096647] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33765c32-9ffc-4499-aa5d-de60b703dbf5',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.161927] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03fa4ca9-532b-43b0-bd53-de11eea0a016 in Status: SUCCESS [ 669.162361] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03fa4ca9-532b-43b0-bd53-de11eea0a016" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.162542] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03fa4ca9-532b-43b0-bd53-de11eea0a016" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.162838] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03fa4ca9-532b-43b0-bd53-de11eea0a016" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.163064] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.163180] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.163349] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.163415] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.163479] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.163568] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03fa4ca9-532b-43b0-bd53-de11eea0a016" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.163658] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('03fa4ca9-532b-43b0-bd53-de11eea0a016',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.599829] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 33765c32-9ffc-4499-aa5d-de60b703dbf5 [ 669.599829] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.599829] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.599829] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.599829] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.599829] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.599829] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:33765c32-9ffc-4499-aa5d-de60b703dbf5 already deleted. [ 669.599829] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-33765c32-9ffc-4499-aa5d-de60b703dbf5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.666151] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-03fa4ca9-532b-43b0-bd53-de11eea0a016 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.669022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03fa4ca9-532b-43b0-bd53-de11eea0a016" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.669022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03fa4ca9-532b-43b0-bd53-de11eea0a016" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.669022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03fa4ca9-532b-43b0-bd53-de11eea0a016" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.669022] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.669022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.669022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.669022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.669022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.669022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03fa4ca9-532b-43b0-bd53-de11eea0a016" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.669022] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-03fa4ca9-532b-43b0-bd53-de11eea0a016 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.669022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03fa4ca9-532b-43b0-bd53-de11eea0a016" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.669022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03fa4ca9-532b-43b0-bd53-de11eea0a016" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.669022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03fa4ca9-532b-43b0-bd53-de11eea0a016" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.669022] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.669022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.669022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.669022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.669022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.669700] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03fa4ca9-532b-43b0-bd53-de11eea0a016" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.669700] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('03fa4ca9-532b-43b0-bd53-de11eea0a016',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.172924] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 03fa4ca9-532b-43b0-bd53-de11eea0a016: rpc.has_security_group_logging(os_id): False [ 670.195132] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.195296] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.195379] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.195615] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.195701] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.195937] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.196076] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.196141] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.196287] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.196375] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.196580] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.196766] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.196766] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.197616] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.197616] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.197616] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.197616] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.197746] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.197832] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.197905] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.197989] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 03fa4ca9-532b-43b0-bd53-de11eea0a016 is going to be created. [ 670.298823] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.298823] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.298823] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.298823] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.298823] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.314831] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 03fa4ca9-532b-43b0-bd53-de11eea0a016 in Status: IN_PROGRESS for 2s [ 670.463733] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ebcad34a-a932-4aaf-93de-b0493166d0cf in Status: SUCCESS [ 670.463733] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ebcad34a-a932-4aaf-93de-b0493166d0cf" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.634551] env[70614]: INFO networking_nsxv3.common.synchronization [None req-eabd5556-cc8b-4b41-89d8-98c12f750a36 None None] Enqueued Resource ID: 0e5c471c-f8ee-4afe-b026-584927a9ed9c with Priority: HIGHEST for action port [ 670.640312] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e5c471c-f8ee-4afe-b026-584927a9ed9c with Priority: HIGHEST for action port [ 670.641132] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-0e5c471c-f8ee-4afe-b026-584927a9ed9c taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.641528] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0e5c471c-f8ee-4afe-b026-584927a9ed9c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.641528] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0e5c471c-f8ee-4afe-b026-584927a9ed9c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.641634] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0e5c471c-f8ee-4afe-b026-584927a9ed9c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.641673] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e5c471c-f8ee-4afe-b026-584927a9ed9c',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.743677] env[70614]: INFO networking_nsxv3.common.synchronization [None req-40b93f26-d3e6-43fd-9122-76cc5f562455 None None] Enqueued Resource ID: 06b4f04d-f92b-487e-95b0-88b85994580b with Priority: HIGHEST for action port [ 670.743677] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06b4f04d-f92b-487e-95b0-88b85994580b with Priority: HIGHEST for action port [ 670.744078] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-06b4f04d-f92b-487e-95b0-88b85994580b taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.744204] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-06b4f04d-f92b-487e-95b0-88b85994580b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.744270] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-06b4f04d-f92b-487e-95b0-88b85994580b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.744909] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-06b4f04d-f92b-487e-95b0-88b85994580b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.746859] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06b4f04d-f92b-487e-95b0-88b85994580b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.945099] env[70614]: INFO networking_nsxv3.common.synchronization [req-983b90c4-b6a7-4f66-aeb1-cc9ffeabd011 req-8f643c44-ae18-493b-aa65-65c97211f358 tempest-DeleteServersAdminTestJSON-938707539 tempest-DeleteServersAdminTestJSON-938707539-project-admin] Enqueued Resource ID: 63a56402-3dcf-44d4-b33d-a56ff531a12c with Priority: HIGHEST for action security_group_members [ 670.945099] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63a56402-3dcf-44d4-b33d-a56ff531a12c with Priority: HIGHEST for action security_group_members [ 670.945099] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-63a56402-3dcf-44d4-b33d-a56ff531a12c taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.945372] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63a56402-3dcf-44d4-b33d-a56ff531a12c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.945372] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63a56402-3dcf-44d4-b33d-a56ff531a12c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.947338] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63a56402-3dcf-44d4-b33d-a56ff531a12c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.947338] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.947338] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.947338] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.947338] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.947338] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.947338] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63a56402-3dcf-44d4-b33d-a56ff531a12c',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.096114] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8c9194b-5e05-4207-a5ab-784203682b19 in Status: SUCCESS [ 671.096362] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8c9194b-5e05-4207-a5ab-784203682b19" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.096662] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8c9194b-5e05-4207-a5ab-784203682b19" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.096896] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8c9194b-5e05-4207-a5ab-784203682b19" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.097097] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.097218] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.097721] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.097721] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.097721] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.097721] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8c9194b-5e05-4207-a5ab-784203682b19" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.097915] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e8c9194b-5e05-4207-a5ab-784203682b19',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.145213] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0e5c471c-f8ee-4afe-b026-584927a9ed9c [ 671.145435] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.145575] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.145644] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.145863] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.145953] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.146170] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0e5c471c-f8ee-4afe-b026-584927a9ed9c already deleted. [ 671.146907] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0e5c471c-f8ee-4afe-b026-584927a9ed9c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.249015] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 06b4f04d-f92b-487e-95b0-88b85994580b [ 671.249565] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.249721] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.250023] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.250085] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.250178] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.250281] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:06b4f04d-f92b-487e-95b0-88b85994580b already deleted. [ 671.250362] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-06b4f04d-f92b-487e-95b0-88b85994580b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.449591] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.449687] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.449764] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.449979] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.450118] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.450318] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.451754] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.451754] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.451754] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.451754] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.451754] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63a56402-3dcf-44d4-b33d-a56ff531a12c is going to be updated. [ 671.486699] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.486767] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.486948] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.487126] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.487176] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.501364] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63a56402-3dcf-44d4-b33d-a56ff531a12c in Status: IN_PROGRESS for 2s [ 671.601235] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e8c9194b-5e05-4207-a5ab-784203682b19',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.092824] env[70614]: INFO networking_nsxv3.common.synchronization [req-f2487724-9a6f-4a31-8c7c-202641b81435 req-4b749561-d4c8-466c-8cb2-13411c4ef233 tempest-DeleteServersTestJSON-1690139659 tempest-DeleteServersTestJSON-1690139659-project-member] Enqueued Resource ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f with Priority: HIGHEST for action security_group_members [ 672.093440] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f with Priority: HIGHEST for action security_group_members [ 672.094076] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.094076] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.094076] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.095826] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.095826] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.095826] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.095826] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.095826] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.095826] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.096117] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df8f20f5-6e92-4ac4-bdd2-05863ac4905f',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.103944] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e8c9194b-5e05-4207-a5ab-784203682b19: rpc.has_security_group_logging(os_id): False [ 672.122733] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.122900] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.122943] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.123169] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.123255] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.123512] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.123616] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.123670] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.123817] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.123907] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.124071] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e8c9194b-5e05-4207-a5ab-784203682b19 is going to be created. [ 672.220165] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.220320] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.220384] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.220597] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.220854] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.238696] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e8c9194b-5e05-4207-a5ab-784203682b19 in Status: IN_PROGRESS for 2s [ 672.337689] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 03fa4ca9-532b-43b0-bd53-de11eea0a016 in Status: SUCCESS [ 672.338073] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-03fa4ca9-532b-43b0-bd53-de11eea0a016" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.599430] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.599624] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.599678] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.600125] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.600125] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.600305] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.600488] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.600521] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.600765] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.600894] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.601044] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f is going to be updated. [ 672.640103] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.640103] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.640103] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.640103] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.640103] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.649991] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f in Status: IN_PROGRESS for 2s [ 672.945964] env[70614]: INFO networking_nsxv3.common.synchronization [None req-ac7964ac-3d07-4027-9f72-059409f13632 None None] Enqueued Resource ID: 3b9f6496-a7f1-4030-90bd-5731901f19c9 with Priority: HIGHEST for action port [ 672.945964] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b9f6496-a7f1-4030-90bd-5731901f19c9 with Priority: HIGHEST for action port [ 672.946614] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-3b9f6496-a7f1-4030-90bd-5731901f19c9 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.946972] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3b9f6496-a7f1-4030-90bd-5731901f19c9" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.949454] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3b9f6496-a7f1-4030-90bd-5731901f19c9" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.949454] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3b9f6496-a7f1-4030-90bd-5731901f19c9" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.949454] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b9f6496-a7f1-4030-90bd-5731901f19c9',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.059047] env[70614]: INFO networking_nsxv3.common.synchronization [None req-aa592066-9f97-43fe-9062-b4d190b75b9c None None] Enqueued Resource ID: e3153bb7-c05e-41ed-9a02-4a48cfec0c95 with Priority: HIGHEST for action port [ 673.059047] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3153bb7-c05e-41ed-9a02-4a48cfec0c95 with Priority: HIGHEST for action port [ 673.059047] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-e3153bb7-c05e-41ed-9a02-4a48cfec0c95 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.059047] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e3153bb7-c05e-41ed-9a02-4a48cfec0c95" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.059047] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e3153bb7-c05e-41ed-9a02-4a48cfec0c95" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.060301] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e3153bb7-c05e-41ed-9a02-4a48cfec0c95" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.060568] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3153bb7-c05e-41ed-9a02-4a48cfec0c95',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.452541] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3b9f6496-a7f1-4030-90bd-5731901f19c9 [ 673.452541] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.453717] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.453823] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.454106] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.454211] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.454326] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3b9f6496-a7f1-4030-90bd-5731901f19c9 already deleted. [ 673.454423] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3b9f6496-a7f1-4030-90bd-5731901f19c9" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.514154] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63a56402-3dcf-44d4-b33d-a56ff531a12c in Status: SUCCESS [ 673.514609] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63a56402-3dcf-44d4-b33d-a56ff531a12c deletion is rescheduled due to dependency. [ 673.514983] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63a56402-3dcf-44d4-b33d-a56ff531a12c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.563389] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e3153bb7-c05e-41ed-9a02-4a48cfec0c95 [ 673.563800] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.564090] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.564418] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.564765] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.565820] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.565820] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e3153bb7-c05e-41ed-9a02-4a48cfec0c95 already deleted. [ 673.565820] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e3153bb7-c05e-41ed-9a02-4a48cfec0c95" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.255587] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e8c9194b-5e05-4207-a5ab-784203682b19 in Status: SUCCESS [ 674.255712] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e8c9194b-5e05-4207-a5ab-784203682b19" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.333251] env[70614]: INFO networking_nsxv3.common.synchronization [None req-425e1c04-aaaf-4b81-a3f4-6dd32661aad9 None None] Enqueued Resource ID: ef6e3aee-1422-4dbd-bef6-bf2c32b01d7f with Priority: HIGHEST for action port [ 674.333606] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef6e3aee-1422-4dbd-bef6-bf2c32b01d7f with Priority: HIGHEST for action port [ 674.334172] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-ef6e3aee-1422-4dbd-bef6-bf2c32b01d7f taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.336018] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ef6e3aee-1422-4dbd-bef6-bf2c32b01d7f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.336018] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ef6e3aee-1422-4dbd-bef6-bf2c32b01d7f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.336018] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ef6e3aee-1422-4dbd-bef6-bf2c32b01d7f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.336018] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef6e3aee-1422-4dbd-bef6-bf2c32b01d7f',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.665288] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f in Status: SUCCESS [ 674.665288] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f deletion is rescheduled due to dependency. [ 674.665288] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.821670] env[70614]: INFO networking_nsxv3.common.synchronization [None req-59732763-c9ae-4b7c-8637-a7aaee780c9d None None] Enqueued Resource ID: 0d39bc67-c649-4587-bea9-6abff6fc77da with Priority: HIGHEST for action port [ 674.821670] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d39bc67-c649-4587-bea9-6abff6fc77da with Priority: HIGHEST for action port [ 674.821670] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-0d39bc67-c649-4587-bea9-6abff6fc77da taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.821670] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0d39bc67-c649-4587-bea9-6abff6fc77da" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.821670] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0d39bc67-c649-4587-bea9-6abff6fc77da" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.823959] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0d39bc67-c649-4587-bea9-6abff6fc77da" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.823959] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d39bc67-c649-4587-bea9-6abff6fc77da',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.842034] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ef6e3aee-1422-4dbd-bef6-bf2c32b01d7f [ 674.842237] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.842458] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.842458] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.843130] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.843130] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.843130] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ef6e3aee-1422-4dbd-bef6-bf2c32b01d7f already deleted. [ 674.843130] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ef6e3aee-1422-4dbd-bef6-bf2c32b01d7f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.146738] env[70614]: INFO networking_nsxv3.common.synchronization [None req-2a9a7e82-524e-4920-a2e9-1445ce5e3a33 None None] Enqueued Resource ID: f9e88e9b-04b1-43c4-a22a-b37edd261a32 with Priority: HIGHEST for action port [ 675.147019] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9e88e9b-04b1-43c4-a22a-b37edd261a32 with Priority: HIGHEST for action port [ 675.147623] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-f9e88e9b-04b1-43c4-a22a-b37edd261a32 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.147772] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f9e88e9b-04b1-43c4-a22a-b37edd261a32" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.147820] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f9e88e9b-04b1-43c4-a22a-b37edd261a32" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.149869] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f9e88e9b-04b1-43c4-a22a-b37edd261a32" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.149869] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f9e88e9b-04b1-43c4-a22a-b37edd261a32',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.330598] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0d39bc67-c649-4587-bea9-6abff6fc77da [ 675.330598] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.330598] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.330598] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.330598] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.330598] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.330598] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0d39bc67-c649-4587-bea9-6abff6fc77da already deleted. [ 675.330598] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0d39bc67-c649-4587-bea9-6abff6fc77da" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.651885] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f9e88e9b-04b1-43c4-a22a-b37edd261a32 [ 675.652100] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.652274] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.652430] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.652541] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.652588] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.652680] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f9e88e9b-04b1-43c4-a22a-b37edd261a32 already deleted. [ 675.652773] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f9e88e9b-04b1-43c4-a22a-b37edd261a32" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.852722] env[70614]: INFO networking_nsxv3.common.synchronization [None req-114d06c3-3672-4acc-aa9b-3dd1ce44610c None None] Enqueued Resource ID: acda7417-f7d9-4b6d-9fd9-21e5f754aadf with Priority: HIGHEST for action port [ 675.852722] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acda7417-f7d9-4b6d-9fd9-21e5f754aadf with Priority: HIGHEST for action port [ 675.852722] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-acda7417-f7d9-4b6d-9fd9-21e5f754aadf taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.852722] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-acda7417-f7d9-4b6d-9fd9-21e5f754aadf" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.852722] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-acda7417-f7d9-4b6d-9fd9-21e5f754aadf" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.853443] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-acda7417-f7d9-4b6d-9fd9-21e5f754aadf" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.853443] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('acda7417-f7d9-4b6d-9fd9-21e5f754aadf',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.362463] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port acda7417-f7d9-4b6d-9fd9-21e5f754aadf [ 676.362725] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.362902] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.363416] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.363416] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.363416] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.363545] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:acda7417-f7d9-4b6d-9fd9-21e5f754aadf already deleted. [ 676.363697] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-acda7417-f7d9-4b6d-9fd9-21e5f754aadf" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.955021] env[70614]: INFO networking_nsxv3.common.synchronization [None req-9e7051fd-1e7d-4080-8b8e-edca3af88629 None None] Enqueued Resource ID: 11d0f9f6-42ef-41f9-86ec-9dd5f2b1deb2 with Priority: HIGHEST for action port [ 676.955021] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11d0f9f6-42ef-41f9-86ec-9dd5f2b1deb2 with Priority: HIGHEST for action port [ 676.955021] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-11d0f9f6-42ef-41f9-86ec-9dd5f2b1deb2 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.955021] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-11d0f9f6-42ef-41f9-86ec-9dd5f2b1deb2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.955021] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-11d0f9f6-42ef-41f9-86ec-9dd5f2b1deb2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.955697] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-11d0f9f6-42ef-41f9-86ec-9dd5f2b1deb2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.955794] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('11d0f9f6-42ef-41f9-86ec-9dd5f2b1deb2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.042978] env[70614]: INFO networking_nsxv3.common.synchronization [None req-38dde2d6-47de-4f35-ad2b-8771c990af6c None None] Enqueued Resource ID: bcb5a1b8-b986-4179-8ee0-fbb724f12f14 with Priority: HIGHEST for action port [ 677.043159] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcb5a1b8-b986-4179-8ee0-fbb724f12f14 with Priority: HIGHEST for action port [ 677.043684] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-bcb5a1b8-b986-4179-8ee0-fbb724f12f14 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.043826] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bcb5a1b8-b986-4179-8ee0-fbb724f12f14" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.043884] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bcb5a1b8-b986-4179-8ee0-fbb724f12f14" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.044285] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bcb5a1b8-b986-4179-8ee0-fbb724f12f14" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.044419] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bcb5a1b8-b986-4179-8ee0-fbb724f12f14',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.458457] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 11d0f9f6-42ef-41f9-86ec-9dd5f2b1deb2 [ 677.458735] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.458882] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.458971] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.459218] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.459308] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.459403] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:11d0f9f6-42ef-41f9-86ec-9dd5f2b1deb2 already deleted. [ 677.459490] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-11d0f9f6-42ef-41f9-86ec-9dd5f2b1deb2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.546843] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bcb5a1b8-b986-4179-8ee0-fbb724f12f14 [ 677.547681] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.547681] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.547681] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.547681] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.547681] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.547983] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bcb5a1b8-b986-4179-8ee0-fbb724f12f14 already deleted. [ 677.547983] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bcb5a1b8-b986-4179-8ee0-fbb724f12f14" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.913160] env[70614]: INFO networking_nsxv3.common.synchronization [None req-b7201add-aa1d-4f67-b8f5-26ee490c293e tempest-ServersTestJSON-658318484 tempest-ServersTestJSON-658318484-project-member] Enqueued Resource ID: 428bc8ce-d8af-4c27-9ff7-291210f88a0a with Priority: HIGHEST for action security_group_rules [ 677.914025] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 428bc8ce-d8af-4c27-9ff7-291210f88a0a with Priority: HIGHEST for action security_group_rules [ 677.914279] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-428bc8ce-d8af-4c27-9ff7-291210f88a0a taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.914435] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-428bc8ce-d8af-4c27-9ff7-291210f88a0a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.914502] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-428bc8ce-d8af-4c27-9ff7-291210f88a0a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.914805] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-428bc8ce-d8af-4c27-9ff7-291210f88a0a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.914880] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('428bc8ce-d8af-4c27-9ff7-291210f88a0a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.243264] env[70614]: INFO networking_nsxv3.common.synchronization [None req-f6245fd6-bf33-49f2-a767-387f1e7873aa tempest-ServersTestJSON-658318484 tempest-ServersTestJSON-658318484-project-member] Enqueued Resource ID: 428bc8ce-d8af-4c27-9ff7-291210f88a0a with Priority: HIGHEST for action security_group_rules [ 678.243952] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 428bc8ce-d8af-4c27-9ff7-291210f88a0a with Priority: HIGHEST for action security_group_rules [ 678.244151] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-428bc8ce-d8af-4c27-9ff7-291210f88a0a taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.244307] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-428bc8ce-d8af-4c27-9ff7-291210f88a0a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.453239] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.453239] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.453239] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.453514] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.453572] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.453637] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 428bc8ce-d8af-4c27-9ff7-291210f88a0a already deleted. [ 678.455075] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-428bc8ce-d8af-4c27-9ff7-291210f88a0a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.455372] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-428bc8ce-d8af-4c27-9ff7-291210f88a0a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.455653] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-428bc8ce-d8af-4c27-9ff7-291210f88a0a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.455733] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('428bc8ce-d8af-4c27-9ff7-291210f88a0a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.744447] env[70614]: INFO networking_nsxv3.common.synchronization [None req-05f316c6-cf5a-4c92-ae18-4676cdb5f4df None None] Enqueued Resource ID: 5cc4db24-56b8-4f03-a2fd-72015763f7f4 with Priority: HIGHEST for action port [ 678.745439] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5cc4db24-56b8-4f03-a2fd-72015763f7f4 with Priority: HIGHEST for action port [ 678.745439] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-5cc4db24-56b8-4f03-a2fd-72015763f7f4 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.745439] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5cc4db24-56b8-4f03-a2fd-72015763f7f4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.746261] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5cc4db24-56b8-4f03-a2fd-72015763f7f4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.749768] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5cc4db24-56b8-4f03-a2fd-72015763f7f4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.749939] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5cc4db24-56b8-4f03-a2fd-72015763f7f4',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.981903] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.982174] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.982266] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.982479] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.982568] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.982710] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 428bc8ce-d8af-4c27-9ff7-291210f88a0a already deleted. [ 678.982807] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-428bc8ce-d8af-4c27-9ff7-291210f88a0a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.157148] env[70614]: INFO networking_nsxv3.common.synchronization [None req-6d696eb7-cb5b-49d2-9ec4-978fc31c11a5 None None] Enqueued Resource ID: 73cf79fd-e48e-4da2-a98a-58cc234cc326 with Priority: HIGHEST for action port [ 679.157148] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73cf79fd-e48e-4da2-a98a-58cc234cc326 with Priority: HIGHEST for action port [ 679.157651] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-73cf79fd-e48e-4da2-a98a-58cc234cc326 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.157960] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-73cf79fd-e48e-4da2-a98a-58cc234cc326" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.158331] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-73cf79fd-e48e-4da2-a98a-58cc234cc326" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.158859] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-73cf79fd-e48e-4da2-a98a-58cc234cc326" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.159068] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73cf79fd-e48e-4da2-a98a-58cc234cc326',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.254126] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5cc4db24-56b8-4f03-a2fd-72015763f7f4 [ 679.254126] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.254126] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.254126] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.254126] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.254822] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.254822] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5cc4db24-56b8-4f03-a2fd-72015763f7f4 already deleted. [ 679.254822] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5cc4db24-56b8-4f03-a2fd-72015763f7f4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.662840] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 73cf79fd-e48e-4da2-a98a-58cc234cc326 [ 679.662840] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.662840] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.662840] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.662840] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.662840] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.662840] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:73cf79fd-e48e-4da2-a98a-58cc234cc326 already deleted. [ 679.662840] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-73cf79fd-e48e-4da2-a98a-58cc234cc326" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.721030] env[70614]: INFO networking_nsxv3.common.synchronization [req-e50858d4-8295-4e25-98a2-1a9021f40173 req-11bc8965-5e0a-4c8d-a101-c5ef390d7849 tempest-MigrationsAdminTest-2080415140 tempest-MigrationsAdminTest-2080415140-project-member] Enqueued Resource ID: 49dd754e-129e-49c8-9e52-09796cb64337 with Priority: HIGHEST for action security_group_members [ 679.721030] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49dd754e-129e-49c8-9e52-09796cb64337 with Priority: HIGHEST for action security_group_members [ 679.721030] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-49dd754e-129e-49c8-9e52-09796cb64337 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.721030] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.721030] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.721030] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.722056] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.722374] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.722915] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.723191] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.724452] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.724452] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49dd754e-129e-49c8-9e52-09796cb64337',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.863445] env[70614]: INFO networking_nsxv3.common.synchronization [None req-191ac414-10b5-44be-9a87-27cb2a787dfe None None] Enqueued Resource ID: fd47b58d-d81d-43b5-aa1e-0373a629b0eb with Priority: HIGHEST for action port [ 679.863445] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd47b58d-d81d-43b5-aa1e-0373a629b0eb with Priority: HIGHEST for action port [ 679.863445] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-fd47b58d-d81d-43b5-aa1e-0373a629b0eb taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.863445] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fd47b58d-d81d-43b5-aa1e-0373a629b0eb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.867598] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fd47b58d-d81d-43b5-aa1e-0373a629b0eb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.867598] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fd47b58d-d81d-43b5-aa1e-0373a629b0eb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.867598] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd47b58d-d81d-43b5-aa1e-0373a629b0eb',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.225249] env[70614]: INFO networking_nsxv3.common.synchronization [req-4e5927a5-b233-4caa-8fa9-9cc323b1fa38 req-a327dca4-f791-49dd-beea-50339f5e2442 tempest-SecurityGroupRulesNegativeTestJSON-179779518 tempest-SecurityGroupRulesNegativeTestJSON-179779518-project-member] Enqueued Resource ID: 8be5ed4c-a60d-4964-bcb1-956e6da1e017 with Priority: HIGHEST for action security_group_rules [ 680.225662] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.225790] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.225875] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.226144] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.226247] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.226433] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.226797] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.226797] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.226870] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.227079] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.227167] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49dd754e-129e-49c8-9e52-09796cb64337 already deleted. [ 680.227243] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.227739] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8be5ed4c-a60d-4964-bcb1-956e6da1e017 with Priority: HIGHEST for action security_group_rules [ 680.232836] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8be5ed4c-a60d-4964-bcb1-956e6da1e017 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.233049] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8be5ed4c-a60d-4964-bcb1-956e6da1e017" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.233128] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8be5ed4c-a60d-4964-bcb1-956e6da1e017" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.233314] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8be5ed4c-a60d-4964-bcb1-956e6da1e017" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.233395] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8be5ed4c-a60d-4964-bcb1-956e6da1e017',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.369571] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fd47b58d-d81d-43b5-aa1e-0373a629b0eb [ 680.369927] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.369927] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.370045] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.370749] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.370749] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.370749] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fd47b58d-d81d-43b5-aa1e-0373a629b0eb already deleted. [ 680.370749] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fd47b58d-d81d-43b5-aa1e-0373a629b0eb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.756568] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.756733] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.756803] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.757032] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.757123] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.757216] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8be5ed4c-a60d-4964-bcb1-956e6da1e017 already deleted. [ 680.757296] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8be5ed4c-a60d-4964-bcb1-956e6da1e017" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.923571] env[70614]: INFO networking_nsxv3.common.synchronization [None req-f39de44e-ab7d-4ed9-a3d9-4d654acd1ae2 None None] Enqueued Resource ID: 0ca4a3e5-6368-4a48-8378-b8022d769516 with Priority: HIGHEST for action port [ 680.923894] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ca4a3e5-6368-4a48-8378-b8022d769516 with Priority: HIGHEST for action port [ 680.924775] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-0ca4a3e5-6368-4a48-8378-b8022d769516 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.925488] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0ca4a3e5-6368-4a48-8378-b8022d769516" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.925488] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0ca4a3e5-6368-4a48-8378-b8022d769516" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.925488] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0ca4a3e5-6368-4a48-8378-b8022d769516" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.925488] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ca4a3e5-6368-4a48-8378-b8022d769516',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.097723] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-573 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.097723] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-573" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.097925] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-573" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.098201] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-573" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.098366] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.098494] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.098607] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.098880] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.098978] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.100243] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 681.100243] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 681.100243] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 681.100243] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 681.100243] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 681.100243] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 681.101407] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 681.123552] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 681.124368] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 681.124368] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 681.124368] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-573" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.125374] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-2882272f-0b52-47c5-b17e-f5704ea905ed taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.125374] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-2882272f-0b52-47c5-b17e-f5704ea905ed" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.125620] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-2882272f-0b52-47c5-b17e-f5704ea905ed" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.125897] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-2882272f-0b52-47c5-b17e-f5704ea905ed" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.126086] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2882272f-0b52-47c5-b17e-f5704ea905ed',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.363236] env[70614]: INFO networking_nsxv3.common.synchronization [None req-c079bd6d-721a-4647-9012-6fe5d1cd0857 None None] Enqueued Resource ID: d49ac4fa-f501-4245-9544-66de3c00ac08 with Priority: HIGHEST for action port [ 681.363985] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d49ac4fa-f501-4245-9544-66de3c00ac08 with Priority: HIGHEST for action port [ 681.365213] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-d49ac4fa-f501-4245-9544-66de3c00ac08 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.365626] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d49ac4fa-f501-4245-9544-66de3c00ac08" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.365626] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d49ac4fa-f501-4245-9544-66de3c00ac08" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.365740] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d49ac4fa-f501-4245-9544-66de3c00ac08" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.365778] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d49ac4fa-f501-4245-9544-66de3c00ac08',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.428068] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0ca4a3e5-6368-4a48-8378-b8022d769516 [ 681.428068] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.428068] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.428068] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.429100] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.429142] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.429236] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0ca4a3e5-6368-4a48-8378-b8022d769516 already deleted. [ 681.430601] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0ca4a3e5-6368-4a48-8378-b8022d769516" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.633472] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.633472] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.633472] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.634012] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.634012] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.634012] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 2882272f-0b52-47c5-b17e-f5704ea905ed not found, creating... [ 681.638026] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.638026] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.638026] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.638026] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.638026] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.638026] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.638026] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.638026] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.638026] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.638026] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.638760] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 2882272f-0b52-47c5-b17e-f5704ea905ed is going to be created. [ 681.660739] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.660914] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.661584] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.661584] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.661584] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.661812] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-2882272f-0b52-47c5-b17e-f5704ea905ed" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.669352] env[70614]: INFO networking_nsxv3.common.synchronization [req-5dc77fcb-565c-4e66-9ad9-7d085610b358 req-b1c44334-e11a-468f-ac53-755dbcd0928e tempest-InstanceActionsNegativeTestJSON-1887447034 tempest-InstanceActionsNegativeTestJSON-1887447034-project-member] Enqueued Resource ID: 954d5d18-f5f4-41ee-a496-48e087a4b527 with Priority: HIGHEST for action security_group_members [ 681.669352] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 954d5d18-f5f4-41ee-a496-48e087a4b527 with Priority: HIGHEST for action security_group_members [ 681.669352] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-954d5d18-f5f4-41ee-a496-48e087a4b527 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.669352] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-954d5d18-f5f4-41ee-a496-48e087a4b527" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.669352] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-954d5d18-f5f4-41ee-a496-48e087a4b527" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.669352] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-954d5d18-f5f4-41ee-a496-48e087a4b527" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.669352] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.669352] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.669352] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.669352] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.669352] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.669352] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('954d5d18-f5f4-41ee-a496-48e087a4b527',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.867994] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d49ac4fa-f501-4245-9544-66de3c00ac08 [ 681.868329] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.868478] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.868550] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.868935] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.868935] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.869083] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d49ac4fa-f501-4245-9544-66de3c00ac08 already deleted. [ 681.869083] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d49ac4fa-f501-4245-9544-66de3c00ac08" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.174220] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.174220] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.174220] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.174440] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.174768] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.174768] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.174900] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.174900] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.175047] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.175136] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.175223] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 954d5d18-f5f4-41ee-a496-48e087a4b527 already deleted. [ 682.175306] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-954d5d18-f5f4-41ee-a496-48e087a4b527" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.309443] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-999 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.309443] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-999" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.309443] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-999" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.309975] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-999" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.313461] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.313461] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.313461] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.313461] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.313461] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.313461] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 682.313461] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 682.313461] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 682.313461] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 682.313461] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 682.313461] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 682.313461] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 682.335108] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 682.335359] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 682.335585] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 682.335812] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-999" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.336220] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-74f896ea-e2d3-43bc-9f9d-76905d55c81d taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.336758] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-74f896ea-e2d3-43bc-9f9d-76905d55c81d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.336758] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-74f896ea-e2d3-43bc-9f9d-76905d55c81d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.337213] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-74f896ea-e2d3-43bc-9f9d-76905d55c81d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.337213] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74f896ea-e2d3-43bc-9f9d-76905d55c81d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.468600] env[70614]: INFO networking_nsxv3.common.synchronization [req-e50858d4-8295-4e25-98a2-1a9021f40173 req-4a4aa2e5-c581-4066-8ebb-96bed19d3e6f service nova] Enqueued Resource ID: 49dd754e-129e-49c8-9e52-09796cb64337 with Priority: HIGHEST for action security_group_rules [ 682.468873] env[70614]: INFO networking_nsxv3.common.synchronization [req-e50858d4-8295-4e25-98a2-1a9021f40173 req-4a4aa2e5-c581-4066-8ebb-96bed19d3e6f service nova] Enqueued Resource ID: 49dd754e-129e-49c8-9e52-09796cb64337 with Priority: HIGHEST for action security_group_members [ 682.468951] env[70614]: INFO networking_nsxv3.common.synchronization [req-e50858d4-8295-4e25-98a2-1a9021f40173 req-4a4aa2e5-c581-4066-8ebb-96bed19d3e6f service nova] Enqueued Resource ID: 2882272f-0b52-47c5-b17e-f5704ea905ed with Priority: HIGHEST for action port [ 682.469233] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49dd754e-129e-49c8-9e52-09796cb64337 with Priority: HIGHEST for action security_group_rules [ 682.469381] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49dd754e-129e-49c8-9e52-09796cb64337 with Priority: HIGHEST for action security_group_members [ 682.469477] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2882272f-0b52-47c5-b17e-f5704ea905ed with Priority: HIGHEST for action port [ 682.471561] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49dd754e-129e-49c8-9e52-09796cb64337 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.471842] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.471949] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.472434] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.473372] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49dd754e-129e-49c8-9e52-09796cb64337',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.474759] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-49dd754e-129e-49c8-9e52-09796cb64337 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.474858] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.474858] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.475155] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.475155] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.475283] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.475333] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.475469] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.475535] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.475642] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49dd754e-129e-49c8-9e52-09796cb64337',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.476541] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-2882272f-0b52-47c5-b17e-f5704ea905ed taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.476669] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2882272f-0b52-47c5-b17e-f5704ea905ed" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.476738] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2882272f-0b52-47c5-b17e-f5704ea905ed" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.476912] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2882272f-0b52-47c5-b17e-f5704ea905ed" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.477009] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2882272f-0b52-47c5-b17e-f5704ea905ed',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.776875] env[70614]: INFO networking_nsxv3.common.synchronization [None req-44914af1-1a6d-43f0-a547-5f6be7d170b9 None None] Enqueued Resource ID: f30b2c11-cb2f-4dd9-8283-c7ac4b1d9cb5 with Priority: HIGHEST for action port [ 682.777674] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f30b2c11-cb2f-4dd9-8283-c7ac4b1d9cb5 with Priority: HIGHEST for action port [ 682.779840] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-f30b2c11-cb2f-4dd9-8283-c7ac4b1d9cb5 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.780654] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f30b2c11-cb2f-4dd9-8283-c7ac4b1d9cb5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.780736] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f30b2c11-cb2f-4dd9-8283-c7ac4b1d9cb5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.781013] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f30b2c11-cb2f-4dd9-8283-c7ac4b1d9cb5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.781115] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f30b2c11-cb2f-4dd9-8283-c7ac4b1d9cb5',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.840285] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.840568] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.840656] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.840955] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.841066] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.841228] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 74f896ea-e2d3-43bc-9f9d-76905d55c81d not found, creating... [ 682.841490] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.841650] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.841771] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.842010] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.842156] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.842446] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.842642] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.842712] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.842918] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.843544] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.843817] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 74f896ea-e2d3-43bc-9f9d-76905d55c81d is going to be created. [ 682.864467] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.864730] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.864907] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.865234] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.865496] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.865763] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-74f896ea-e2d3-43bc-9f9d-76905d55c81d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.979486] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-49dd754e-129e-49c8-9e52-09796cb64337 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.979695] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.983071] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('49dd754e-129e-49c8-9e52-09796cb64337',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.984053] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2882272f-0b52-47c5-b17e-f5704ea905ed with status ACTIVE [ 682.984255] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.984386] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.984630] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.984883] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.984883] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.986045] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.986549] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.986549] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.989115] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.989115] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.989115] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.989115] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.989115] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.989115] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.989115] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.989115] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2882272f-0b52-47c5-b17e-f5704ea905ed is going to be updated. [ 683.024151] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.024151] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.024151] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.024590] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.024745] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.024914] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2882272f-0b52-47c5-b17e-f5704ea905ed" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.283480] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f30b2c11-cb2f-4dd9-8283-c7ac4b1d9cb5 [ 683.283779] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.283905] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.283991] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.284816] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.284985] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.286235] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f30b2c11-cb2f-4dd9-8283-c7ac4b1d9cb5 already deleted. [ 683.286235] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f30b2c11-cb2f-4dd9-8283-c7ac4b1d9cb5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.477700] env[70614]: INFO networking_nsxv3.common.synchronization [req-0766a92d-47f8-41e7-a2d2-815f4287f55e req-79cc0f79-4ae1-4f19-856a-9104bafd2549 tempest-ServersWithSpecificFlavorTestJSON-1815410269 tempest-ServersWithSpecificFlavorTestJSON-1815410269-project-member] Enqueued Resource ID: ca9b1416-779b-4bc5-ae29-5117ebb9bc1a with Priority: HIGHEST for action security_group_members [ 683.478810] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca9b1416-779b-4bc5-ae29-5117ebb9bc1a with Priority: HIGHEST for action security_group_members [ 683.478810] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.478810] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.478810] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.481048] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.482045] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.482045] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.482045] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.482045] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.482045] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.482045] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca9b1416-779b-4bc5-ae29-5117ebb9bc1a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.490224] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('49dd754e-129e-49c8-9e52-09796cb64337',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.982796] env[70614]: INFO networking_nsxv3.common.synchronization [req-5dc77fcb-565c-4e66-9ad9-7d085610b358 req-1fc5fcc8-0385-4ce9-82f1-8a0c634a72df service nova] Enqueued Resource ID: 954d5d18-f5f4-41ee-a496-48e087a4b527 with Priority: HIGHEST for action security_group_rules [ 683.982796] env[70614]: INFO networking_nsxv3.common.synchronization [req-5dc77fcb-565c-4e66-9ad9-7d085610b358 req-1fc5fcc8-0385-4ce9-82f1-8a0c634a72df service nova] Enqueued Resource ID: 954d5d18-f5f4-41ee-a496-48e087a4b527 with Priority: HIGHEST for action security_group_members [ 683.982796] env[70614]: INFO networking_nsxv3.common.synchronization [req-5dc77fcb-565c-4e66-9ad9-7d085610b358 req-1fc5fcc8-0385-4ce9-82f1-8a0c634a72df service nova] Enqueued Resource ID: 74f896ea-e2d3-43bc-9f9d-76905d55c81d with Priority: HIGHEST for action port [ 683.982796] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 954d5d18-f5f4-41ee-a496-48e087a4b527 with Priority: HIGHEST for action security_group_rules [ 683.982796] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 954d5d18-f5f4-41ee-a496-48e087a4b527 with Priority: HIGHEST for action security_group_members [ 683.983117] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74f896ea-e2d3-43bc-9f9d-76905d55c81d with Priority: HIGHEST for action port [ 683.983953] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-954d5d18-f5f4-41ee-a496-48e087a4b527 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.983953] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-954d5d18-f5f4-41ee-a496-48e087a4b527" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.983953] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-954d5d18-f5f4-41ee-a496-48e087a4b527" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.984097] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-954d5d18-f5f4-41ee-a496-48e087a4b527" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.984236] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('954d5d18-f5f4-41ee-a496-48e087a4b527',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.985499] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-954d5d18-f5f4-41ee-a496-48e087a4b527 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.985617] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-954d5d18-f5f4-41ee-a496-48e087a4b527" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.985685] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-954d5d18-f5f4-41ee-a496-48e087a4b527" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.986842] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-954d5d18-f5f4-41ee-a496-48e087a4b527" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.986842] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.986842] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.986842] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.986842] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.986842] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.986842] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('954d5d18-f5f4-41ee-a496-48e087a4b527',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.987816] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-74f896ea-e2d3-43bc-9f9d-76905d55c81d taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.988128] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-74f896ea-e2d3-43bc-9f9d-76905d55c81d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.988128] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-74f896ea-e2d3-43bc-9f9d-76905d55c81d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.988441] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-74f896ea-e2d3-43bc-9f9d-76905d55c81d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.988441] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74f896ea-e2d3-43bc-9f9d-76905d55c81d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.991504] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.992877] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.993746] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.993746] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.993746] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.993746] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.994308] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.996017] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.996017] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.996017] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.996017] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca9b1416-779b-4bc5-ae29-5117ebb9bc1a already deleted. [ 683.996017] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.996017] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.996017] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.996773] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.997497] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.997709] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.998965] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49dd754e-129e-49c8-9e52-09796cb64337 is going to be created. [ 684.037418] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.037596] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.037659] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.039104] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.039104] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.048161] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49dd754e-129e-49c8-9e52-09796cb64337 in Status: UNINITIALIZED for 2s [ 684.143050] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-996 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.143050] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-996" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.143050] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-996" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.143050] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-996" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.143427] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.143526] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.143751] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.144547] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.144547] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.144547] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 684.144547] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 684.144547] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 684.144861] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 684.144861] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 684.144861] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 684.145009] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 684.167786] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 684.168037] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 684.168217] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 684.168548] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-996" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.168826] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-70f99740-18e6-4e83-bcf2-b6f8981da504 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.169064] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-70f99740-18e6-4e83-bcf2-b6f8981da504" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.169205] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-70f99740-18e6-4e83-bcf2-b6f8981da504" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.169618] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-70f99740-18e6-4e83-bcf2-b6f8981da504" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.169746] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70f99740-18e6-4e83-bcf2-b6f8981da504',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.491555] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 74f896ea-e2d3-43bc-9f9d-76905d55c81d with status ACTIVE [ 684.491885] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.495392] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.495601] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.495847] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.496041] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.496292] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.496402] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.496468] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.496727] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.496817] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.497036] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.497176] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.497460] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.497460] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.497691] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.497691] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 74f896ea-e2d3-43bc-9f9d-76905d55c81d is going to be updated. [ 684.500640] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('954d5d18-f5f4-41ee-a496-48e087a4b527',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.502047] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-954d5d18-f5f4-41ee-a496-48e087a4b527 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.502666] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-954d5d18-f5f4-41ee-a496-48e087a4b527" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.513675] env[70614]: INFO networking_nsxv3.common.synchronization [req-6dc87603-5879-4123-9b22-b5704621405b req-553cdfd0-6046-4e71-af38-42bb0f0065ec tempest-SecurityGroupRulesNegativeTestJSON-179779518 tempest-SecurityGroupRulesNegativeTestJSON-179779518-project-member] Enqueued Resource ID: 8be5ed4c-a60d-4964-bcb1-956e6da1e017 with Priority: HIGHEST for action security_group_rules [ 684.514300] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8be5ed4c-a60d-4964-bcb1-956e6da1e017 with Priority: HIGHEST for action security_group_rules [ 684.515129] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8be5ed4c-a60d-4964-bcb1-956e6da1e017 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.515129] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8be5ed4c-a60d-4964-bcb1-956e6da1e017" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.515129] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8be5ed4c-a60d-4964-bcb1-956e6da1e017" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.517359] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8be5ed4c-a60d-4964-bcb1-956e6da1e017" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.517359] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8be5ed4c-a60d-4964-bcb1-956e6da1e017',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.527569] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.528048] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.528217] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.532201] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.532560] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.532661] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-74f896ea-e2d3-43bc-9f9d-76905d55c81d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.627852] env[70614]: INFO networking_nsxv3.common.synchronization [None req-d0cce368-3e91-466e-920b-98c6e2fbb276 None None] Enqueued Resource ID: 27981496-14ab-46b6-ae95-e8f62cc26255 with Priority: HIGHEST for action port [ 684.629286] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27981496-14ab-46b6-ae95-e8f62cc26255 with Priority: HIGHEST for action port [ 684.630151] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-27981496-14ab-46b6-ae95-e8f62cc26255 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.630400] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-27981496-14ab-46b6-ae95-e8f62cc26255" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.630609] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-27981496-14ab-46b6-ae95-e8f62cc26255" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.632065] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-27981496-14ab-46b6-ae95-e8f62cc26255" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.632289] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27981496-14ab-46b6-ae95-e8f62cc26255',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.672672] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.672900] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.673043] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.673355] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.673503] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.673665] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 70f99740-18e6-4e83-bcf2-b6f8981da504 not found, creating... [ 684.673934] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.674128] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.674255] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.674467] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.674624] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.674948] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.675159] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.675295] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.675494] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.675624] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.675756] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 70f99740-18e6-4e83-bcf2-b6f8981da504 is going to be created. [ 684.700513] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.700513] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.700875] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.701315] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.701710] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.702062] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-70f99740-18e6-4e83-bcf2-b6f8981da504" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.995898] env[70614]: INFO networking_nsxv3.common.synchronization [req-397ad0f8-5fe0-43c3-b60c-05dddc63057b req-f9d1269a-4382-49ab-8cce-2b10a153a30a tempest-TenantUsagesTestJSON-1480594672 tempest-TenantUsagesTestJSON-1480594672-project-member] Enqueued Resource ID: 05ee2574-9125-4ff3-8197-e0eb7f0c45f2 with Priority: HIGHEST for action security_group_members [ 684.996515] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05ee2574-9125-4ff3-8197-e0eb7f0c45f2 with Priority: HIGHEST for action security_group_members [ 684.996875] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-05ee2574-9125-4ff3-8197-e0eb7f0c45f2 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.001225] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05ee2574-9125-4ff3-8197-e0eb7f0c45f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.001381] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05ee2574-9125-4ff3-8197-e0eb7f0c45f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.001616] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05ee2574-9125-4ff3-8197-e0eb7f0c45f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.004145] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.004145] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.004145] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.004145] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.004145] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.004145] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('05ee2574-9125-4ff3-8197-e0eb7f0c45f2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.004145] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('954d5d18-f5f4-41ee-a496-48e087a4b527',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.043625] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.043625] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.043625] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.043625] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.043625] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.043625] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8be5ed4c-a60d-4964-bcb1-956e6da1e017 already deleted. [ 685.043625] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8be5ed4c-a60d-4964-bcb1-956e6da1e017" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.134983] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 27981496-14ab-46b6-ae95-e8f62cc26255 [ 685.137035] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.137035] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.137035] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.137035] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.137035] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.137035] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:27981496-14ab-46b6-ae95-e8f62cc26255 already deleted. [ 685.137035] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-27981496-14ab-46b6-ae95-e8f62cc26255" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.261166] env[70614]: INFO networking_nsxv3.common.synchronization [None req-ac2bdcad-c9ee-43bd-8337-e42faba31548 None None] Enqueued Resource ID: 9503f1fd-8686-4dbe-b309-073b4276c3c3 with Priority: HIGHEST for action port [ 685.261166] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9503f1fd-8686-4dbe-b309-073b4276c3c3 with Priority: HIGHEST for action port [ 685.261166] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-9503f1fd-8686-4dbe-b309-073b4276c3c3 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.261166] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9503f1fd-8686-4dbe-b309-073b4276c3c3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.261166] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9503f1fd-8686-4dbe-b309-073b4276c3c3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.261166] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9503f1fd-8686-4dbe-b309-073b4276c3c3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.261166] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9503f1fd-8686-4dbe-b309-073b4276c3c3',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.505476] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.509030] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.509030] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.509030] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.509030] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.509030] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.509030] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.509030] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.509030] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.509030] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.509030] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05ee2574-9125-4ff3-8197-e0eb7f0c45f2 is going to be updated. [ 685.509030] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.509030] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.509030] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.509030] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.509030] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.510092] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 954d5d18-f5f4-41ee-a496-48e087a4b527 is going to be created. [ 685.534653] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.534811] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.534879] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.535156] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.535313] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.542849] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.542991] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.543066] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.543291] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.543454] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.548042] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 954d5d18-f5f4-41ee-a496-48e087a4b527 in Status: UNINITIALIZED for 2s [ 685.555942] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05ee2574-9125-4ff3-8197-e0eb7f0c45f2 in Status: IN_PROGRESS for 2s [ 685.765784] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9503f1fd-8686-4dbe-b309-073b4276c3c3 [ 685.767268] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.767268] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.767268] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.767268] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.767268] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.767526] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9503f1fd-8686-4dbe-b309-073b4276c3c3 already deleted. [ 685.767526] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9503f1fd-8686-4dbe-b309-073b4276c3c3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.058479] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49dd754e-129e-49c8-9e52-09796cb64337 in Status: SUCCESS [ 686.058942] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.059167] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.059394] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.059588] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.059870] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.059928] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.060082] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.060168] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.060255] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.060348] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('49dd754e-129e-49c8-9e52-09796cb64337',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.285265] env[70614]: INFO networking_nsxv3.common.synchronization [req-0766a92d-47f8-41e7-a2d2-815f4287f55e req-5f7345ee-21d6-4600-a30c-b5f066dda0d3 service nova] Enqueued Resource ID: ca9b1416-779b-4bc5-ae29-5117ebb9bc1a with Priority: HIGHEST for action security_group_rules [ 686.285491] env[70614]: INFO networking_nsxv3.common.synchronization [req-0766a92d-47f8-41e7-a2d2-815f4287f55e req-5f7345ee-21d6-4600-a30c-b5f066dda0d3 service nova] Enqueued Resource ID: ca9b1416-779b-4bc5-ae29-5117ebb9bc1a with Priority: HIGHEST for action security_group_members [ 686.285630] env[70614]: INFO networking_nsxv3.common.synchronization [req-0766a92d-47f8-41e7-a2d2-815f4287f55e req-5f7345ee-21d6-4600-a30c-b5f066dda0d3 service nova] Enqueued Resource ID: 70f99740-18e6-4e83-bcf2-b6f8981da504 with Priority: HIGHEST for action port [ 686.286336] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca9b1416-779b-4bc5-ae29-5117ebb9bc1a with Priority: HIGHEST for action security_group_rules [ 686.286473] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca9b1416-779b-4bc5-ae29-5117ebb9bc1a with Priority: HIGHEST for action security_group_members [ 686.286586] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70f99740-18e6-4e83-bcf2-b6f8981da504 with Priority: HIGHEST for action port [ 686.287071] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.287071] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.287273] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.287351] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.287430] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca9b1416-779b-4bc5-ae29-5117ebb9bc1a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.291741] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.291890] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.291958] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.292374] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.292691] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.292925] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.292972] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.293335] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.293335] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.293425] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca9b1416-779b-4bc5-ae29-5117ebb9bc1a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.297021] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-70f99740-18e6-4e83-bcf2-b6f8981da504 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.297021] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-70f99740-18e6-4e83-bcf2-b6f8981da504" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.297021] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-70f99740-18e6-4e83-bcf2-b6f8981da504" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.297021] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-70f99740-18e6-4e83-bcf2-b6f8981da504" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.297021] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70f99740-18e6-4e83-bcf2-b6f8981da504',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.491202] env[70614]: INFO networking_nsxv3.common.synchronization [req-38979367-b0d6-4f40-ab64-eccf9671617b req-16dc0ae1-f468-4f1c-b7cd-3bec30b12069 tempest-ServersAdminTestJSON-365827888 tempest-ServersAdminTestJSON-365827888-project-member] Enqueued Resource ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b with Priority: HIGHEST for action security_group_members [ 686.491919] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b with Priority: HIGHEST for action security_group_members [ 686.491919] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.491919] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.491919] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.494059] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.495072] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.495072] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.495072] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.495072] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.495072] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.495072] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.562570] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-49dd754e-129e-49c8-9e52-09796cb64337 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.563013] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.563013] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.563013] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.563321] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.563321] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.563423] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.563698] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.563698] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.563698] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.563837] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-49dd754e-129e-49c8-9e52-09796cb64337 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.563917] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.563959] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.564108] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.565139] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.565139] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.565139] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.565139] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.565139] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.565139] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.565139] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('49dd754e-129e-49c8-9e52-09796cb64337',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.799097] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.799097] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.799097] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca9b1416-779b-4bc5-ae29-5117ebb9bc1a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.799097] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 70f99740-18e6-4e83-bcf2-b6f8981da504 with status ACTIVE [ 686.799097] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.799097] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.799097] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.799097] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.799097] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.799472] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.799472] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.799472] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.799638] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.799729] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.800009] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.800009] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.803022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.803022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.803022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.803022] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 70f99740-18e6-4e83-bcf2-b6f8981da504 is going to be updated. [ 686.828696] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.828696] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.828696] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.828696] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.828696] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.828696] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-70f99740-18e6-4e83-bcf2-b6f8981da504" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.001240] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.001366] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.001437] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.002113] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.002113] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.002113] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.002476] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.002476] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.002476] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.002476] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.002677] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b already deleted. [ 687.002677] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.070853] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 49dd754e-129e-49c8-9e52-09796cb64337: rpc.has_security_group_logging(os_id): False [ 687.093731] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.093731] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.093731] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.093731] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.094124] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.094124] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.094250] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.094250] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.094509] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.094509] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.094823] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.095910] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.096140] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.096384] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.096516] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.097235] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.097538] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.097680] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.098041] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.098180] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.098317] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49dd754e-129e-49c8-9e52-09796cb64337 is going to be created. [ 687.162612] env[70614]: INFO networking_nsxv3.common.synchronization [None req-b54b2a36-39aa-4a36-9195-c0faecd00096 None None] Enqueued Resource ID: 88270d39-4bca-4167-84e3-9caf310741f9 with Priority: HIGHEST for action port [ 687.163142] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88270d39-4bca-4167-84e3-9caf310741f9 with Priority: HIGHEST for action port [ 687.163429] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-88270d39-4bca-4167-84e3-9caf310741f9 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.163575] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-88270d39-4bca-4167-84e3-9caf310741f9" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.163745] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-88270d39-4bca-4167-84e3-9caf310741f9" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.163962] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-88270d39-4bca-4167-84e3-9caf310741f9" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.164300] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88270d39-4bca-4167-84e3-9caf310741f9',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.175051] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.175484] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.175484] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.175939] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.175939] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.191447] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49dd754e-129e-49c8-9e52-09796cb64337 in Status: IN_PROGRESS for 2s [ 687.283158] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-746 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.283158] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-746" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.283158] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-746" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.283158] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-746" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.283158] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.283158] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.283158] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.283158] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.283158] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.283158] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 687.284103] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 687.284364] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 687.284670] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 687.284910] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 687.285242] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 687.285586] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 687.308479] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 687.308676] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 687.308819] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 687.309495] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-746" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.309495] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-6165402b-bef6-4473-8c16-4f6ae2ac528d taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.309689] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-6165402b-bef6-4473-8c16-4f6ae2ac528d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.309966] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-6165402b-bef6-4473-8c16-4f6ae2ac528d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.310067] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-6165402b-bef6-4473-8c16-4f6ae2ac528d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.310188] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6165402b-bef6-4473-8c16-4f6ae2ac528d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.311362] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca9b1416-779b-4bc5-ae29-5117ebb9bc1a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.558768] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 954d5d18-f5f4-41ee-a496-48e087a4b527 in Status: SUCCESS [ 687.559018] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-954d5d18-f5f4-41ee-a496-48e087a4b527" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.559176] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-954d5d18-f5f4-41ee-a496-48e087a4b527" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.559387] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-954d5d18-f5f4-41ee-a496-48e087a4b527" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.559575] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.560152] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.560152] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.560152] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.560152] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.560400] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-954d5d18-f5f4-41ee-a496-48e087a4b527" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.560592] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('954d5d18-f5f4-41ee-a496-48e087a4b527',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.568475] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05ee2574-9125-4ff3-8197-e0eb7f0c45f2 in Status: SUCCESS [ 687.568475] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05ee2574-9125-4ff3-8197-e0eb7f0c45f2 deletion is rescheduled due to dependency. [ 687.568475] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05ee2574-9125-4ff3-8197-e0eb7f0c45f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.667910] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 88270d39-4bca-4167-84e3-9caf310741f9 [ 687.671424] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.671424] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.671424] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.671424] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.671424] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.671424] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:88270d39-4bca-4167-84e3-9caf310741f9 already deleted. [ 687.671424] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-88270d39-4bca-4167-84e3-9caf310741f9" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.814390] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.815225] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.815225] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.815421] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.815544] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.815737] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 6165402b-bef6-4473-8c16-4f6ae2ac528d not found, creating... [ 687.817682] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.817682] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.817682] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.817682] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.817682] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.817682] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.817682] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.817682] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.818179] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.818179] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.818251] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 6165402b-bef6-4473-8c16-4f6ae2ac528d is going to be created. [ 687.819917] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.819917] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.819917] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.820665] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.820665] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.820665] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca9b1416-779b-4bc5-ae29-5117ebb9bc1a is going to be created. [ 687.847374] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.847586] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.847707] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.847991] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.849390] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.849390] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-6165402b-bef6-4473-8c16-4f6ae2ac528d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.853744] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.853938] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.854047] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.854279] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.854467] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.867923] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca9b1416-779b-4bc5-ae29-5117ebb9bc1a in Status: UNINITIALIZED for 2s [ 688.065136] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-954d5d18-f5f4-41ee-a496-48e087a4b527 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.065136] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-954d5d18-f5f4-41ee-a496-48e087a4b527" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.065136] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-954d5d18-f5f4-41ee-a496-48e087a4b527" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.065136] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-954d5d18-f5f4-41ee-a496-48e087a4b527" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.065659] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.065659] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.065659] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.065897] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.066033] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.066144] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-954d5d18-f5f4-41ee-a496-48e087a4b527" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.066333] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-954d5d18-f5f4-41ee-a496-48e087a4b527 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.066442] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-954d5d18-f5f4-41ee-a496-48e087a4b527" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.066723] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-954d5d18-f5f4-41ee-a496-48e087a4b527" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.066915] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-954d5d18-f5f4-41ee-a496-48e087a4b527" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.067099] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.067229] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.067314] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.067475] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.067661] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.067776] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-954d5d18-f5f4-41ee-a496-48e087a4b527" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.067924] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('954d5d18-f5f4-41ee-a496-48e087a4b527',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.573551] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 954d5d18-f5f4-41ee-a496-48e087a4b527: rpc.has_security_group_logging(os_id): False [ 688.596542] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.596542] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.596542] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.596542] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.596542] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.597009] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.597009] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.597009] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.597193] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.597313] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.597600] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.598502] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.598502] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.598502] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.599238] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.599553] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.599726] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.599780] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.600061] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.600790] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.602287] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 954d5d18-f5f4-41ee-a496-48e087a4b527 is going to be created. [ 688.698512] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.698512] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.698512] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.698512] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.698512] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.722929] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 954d5d18-f5f4-41ee-a496-48e087a4b527 in Status: IN_PROGRESS for 2s [ 689.207773] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49dd754e-129e-49c8-9e52-09796cb64337 in Status: SUCCESS [ 689.207895] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.225303] env[70614]: INFO networking_nsxv3.common.synchronization [req-38979367-b0d6-4f40-ab64-eccf9671617b req-52a05369-23c2-4e21-b209-67d3fba335af service nova] Enqueued Resource ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b with Priority: HIGHEST for action security_group_rules [ 689.225475] env[70614]: INFO networking_nsxv3.common.synchronization [req-38979367-b0d6-4f40-ab64-eccf9671617b req-52a05369-23c2-4e21-b209-67d3fba335af service nova] Enqueued Resource ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b with Priority: HIGHEST for action security_group_members [ 689.225611] env[70614]: INFO networking_nsxv3.common.synchronization [req-38979367-b0d6-4f40-ab64-eccf9671617b req-52a05369-23c2-4e21-b209-67d3fba335af service nova] Enqueued Resource ID: 6165402b-bef6-4473-8c16-4f6ae2ac528d with Priority: HIGHEST for action port [ 689.225841] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b with Priority: HIGHEST for action security_group_rules [ 689.225995] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b with Priority: HIGHEST for action security_group_members [ 689.226107] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6165402b-bef6-4473-8c16-4f6ae2ac528d with Priority: HIGHEST for action port [ 689.226663] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.226814] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.226921] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.228397] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.228534] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.230462] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.230587] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.230663] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.230998] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.231242] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.231296] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.231345] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.231482] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.231570] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.231663] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.233307] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-6165402b-bef6-4473-8c16-4f6ae2ac528d taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.233542] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6165402b-bef6-4473-8c16-4f6ae2ac528d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.233542] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6165402b-bef6-4473-8c16-4f6ae2ac528d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.234869] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6165402b-bef6-4473-8c16-4f6ae2ac528d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.234869] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6165402b-bef6-4473-8c16-4f6ae2ac528d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.550032] env[70614]: INFO networking_nsxv3.common.synchronization [req-c4a55038-f4bc-41c6-9d4b-7943ef269c1a req-723e2d63-b02d-445c-bedc-7530dc5292b7 tempest-ServersAdminTestJSON-365827888 tempest-ServersAdminTestJSON-365827888-project-member] Enqueued Resource ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b with Priority: HIGHEST for action security_group_members [ 689.551707] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b with Priority: HIGHEST for action security_group_members [ 689.551707] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.551707] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.732262] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.732953] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.737478] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6165402b-bef6-4473-8c16-4f6ae2ac528d with status ACTIVE [ 689.737756] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.737957] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.738048] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.738285] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.738393] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.738573] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.738698] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.738770] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.738997] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.739123] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.739994] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.739994] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.739994] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.739994] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.739994] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.739994] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6165402b-bef6-4473-8c16-4f6ae2ac528d is going to be updated. [ 689.741031] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.773544] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.773682] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.773757] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.774014] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.774842] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.775087] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6165402b-bef6-4473-8c16-4f6ae2ac528d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.881176] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca9b1416-779b-4bc5-ae29-5117ebb9bc1a in Status: SUCCESS [ 689.881556] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.881654] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.882248] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.882632] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.882764] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.882842] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.883209] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.883209] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.883833] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.883833] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ca9b1416-779b-4bc5-ae29-5117ebb9bc1a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.093231] env[70614]: INFO networking_nsxv3.common.synchronization [None req-b4783669-b911-4f49-a24d-92e616fad708 None None] Enqueued Resource ID: 3f7f2836-93c9-4ee5-a244-ce1db9b63c49 with Priority: HIGHEST for action port [ 690.093231] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f7f2836-93c9-4ee5-a244-ce1db9b63c49 with Priority: HIGHEST for action port [ 690.093231] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-3f7f2836-93c9-4ee5-a244-ce1db9b63c49 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.093231] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3f7f2836-93c9-4ee5-a244-ce1db9b63c49" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.093231] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3f7f2836-93c9-4ee5-a244-ce1db9b63c49" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.094352] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3f7f2836-93c9-4ee5-a244-ce1db9b63c49" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.094847] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f7f2836-93c9-4ee5-a244-ce1db9b63c49',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.229819] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-746 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.230086] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-746" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.230160] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-746" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.230825] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-746" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.230825] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.231087] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.234145] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.234145] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.234145] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.234668] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 690.234668] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 690.234668] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 690.234812] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 690.235153] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 690.235153] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 690.235153] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 690.248360] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.260808] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 690.261068] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 690.261216] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 690.261416] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-746" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.261780] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-9cbe0302-8ba8-453c-b517-13962a57745d taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.261999] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-9cbe0302-8ba8-453c-b517-13962a57745d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.262165] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-9cbe0302-8ba8-453c-b517-13962a57745d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.262583] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-9cbe0302-8ba8-453c-b517-13962a57745d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.262633] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9cbe0302-8ba8-453c-b517-13962a57745d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.386662] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ca9b1416-779b-4bc5-ae29-5117ebb9bc1a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.597792] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3f7f2836-93c9-4ee5-a244-ce1db9b63c49 [ 690.598233] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.598439] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.598439] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.598646] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.598733] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.598844] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3f7f2836-93c9-4ee5-a244-ce1db9b63c49 already deleted. [ 690.599029] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3f7f2836-93c9-4ee5-a244-ce1db9b63c49" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.739506] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 954d5d18-f5f4-41ee-a496-48e087a4b527 in Status: SUCCESS [ 690.739506] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-954d5d18-f5f4-41ee-a496-48e087a4b527" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.752232] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.752526] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.752526] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.752718] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.752802] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.752896] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b is going to be created. [ 690.764676] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.765539] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.765539] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.766091] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.766219] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.766395] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 9cbe0302-8ba8-453c-b517-13962a57745d not found, creating... [ 690.766744] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.766942] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.767044] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.767408] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.767559] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.767919] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.768090] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.768211] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.769029] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.769176] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.769483] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 9cbe0302-8ba8-453c-b517-13962a57745d is going to be created. [ 690.784527] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.785218] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.785218] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.785218] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.785218] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.794359] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.796027] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.796219] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.796954] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.797226] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.797466] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-9cbe0302-8ba8-453c-b517-13962a57745d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.806137] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b in Status: UNINITIALIZED for 2s [ 690.889651] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ca9b1416-779b-4bc5-ae29-5117ebb9bc1a: rpc.has_security_group_logging(os_id): False [ 690.915504] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.915687] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.915999] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.916201] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.916332] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.916615] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.916744] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.916903] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.917120] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.917120] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.917187] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca9b1416-779b-4bc5-ae29-5117ebb9bc1a is going to be created. [ 690.990398] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.990595] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.990679] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.991160] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.991262] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.017710] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca9b1416-779b-4bc5-ae29-5117ebb9bc1a in Status: IN_PROGRESS for 2s [ 691.685947] env[70614]: INFO networking_nsxv3.common.synchronization [req-c4a55038-f4bc-41c6-9d4b-7943ef269c1a req-dc4c6192-de76-4a9d-86fc-c65d87314722 service nova] Enqueued Resource ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b with Priority: HIGHEST for action security_group_rules [ 691.687618] env[70614]: INFO networking_nsxv3.common.synchronization [req-c4a55038-f4bc-41c6-9d4b-7943ef269c1a req-dc4c6192-de76-4a9d-86fc-c65d87314722 service nova] Enqueued Resource ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b with Priority: HIGHEST for action security_group_members [ 691.687798] env[70614]: INFO networking_nsxv3.common.synchronization [req-c4a55038-f4bc-41c6-9d4b-7943ef269c1a req-dc4c6192-de76-4a9d-86fc-c65d87314722 service nova] Enqueued Resource ID: 9cbe0302-8ba8-453c-b517-13962a57745d with Priority: HIGHEST for action port [ 691.691165] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b with Priority: HIGHEST for action security_group_rules [ 691.691284] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b with Priority: HIGHEST for action security_group_members [ 691.691346] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cbe0302-8ba8-453c-b517-13962a57745d with Priority: HIGHEST for action port [ 691.691770] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.692021] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.692569] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.692799] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.692999] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-9cbe0302-8ba8-453c-b517-13962a57745d taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.693685] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9cbe0302-8ba8-453c-b517-13962a57745d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.693685] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9cbe0302-8ba8-453c-b517-13962a57745d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.693685] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9cbe0302-8ba8-453c-b517-13962a57745d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.693685] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9cbe0302-8ba8-453c-b517-13962a57745d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.202030] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9cbe0302-8ba8-453c-b517-13962a57745d with status ACTIVE [ 692.202030] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.202030] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.202030] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.202030] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.202030] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.202030] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.202030] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.202030] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.202030] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.202030] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.202030] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.202030] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.202030] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.202030] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.202030] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.202030] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9cbe0302-8ba8-453c-b517-13962a57745d is going to be updated. [ 692.229277] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.229277] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.229416] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.229664] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.229976] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.230104] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9cbe0302-8ba8-453c-b517-13962a57745d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.820289] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b in Status: SUCCESS [ 692.820923] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.820923] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.821118] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.821193] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.821337] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.821406] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.821633] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.821762] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.821880] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.978826] env[70614]: INFO networking_nsxv3.common.synchronization [None req-a47d1c82-6d84-4e1f-9c41-3d2c4cbe4a60 None None] Enqueued Resource ID: 427034f6-ed89-473b-9141-4075f272c4b8 with Priority: HIGHEST for action port [ 692.979850] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 427034f6-ed89-473b-9141-4075f272c4b8 with Priority: HIGHEST for action port [ 692.980243] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-427034f6-ed89-473b-9141-4075f272c4b8 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.983043] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-427034f6-ed89-473b-9141-4075f272c4b8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.983043] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-427034f6-ed89-473b-9141-4075f272c4b8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.983043] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-427034f6-ed89-473b-9141-4075f272c4b8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.983043] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('427034f6-ed89-473b-9141-4075f272c4b8',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.034799] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca9b1416-779b-4bc5-ae29-5117ebb9bc1a in Status: SUCCESS [ 693.034999] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.328018] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.489888] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 427034f6-ed89-473b-9141-4075f272c4b8 [ 693.490722] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.491061] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.491061] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.491430] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.491559] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.491693] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:427034f6-ed89-473b-9141-4075f272c4b8 already deleted. [ 693.491828] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-427034f6-ed89-473b-9141-4075f272c4b8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.831261] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.335698] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.336088] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.336088] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.337032] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.337032] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.337032] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b is going to be updated. [ 694.366255] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.366255] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.366255] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.366255] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.369305] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.379943] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b in Status: IN_PROGRESS for 2s [ 694.761223] env[70614]: INFO networking_nsxv3.common.synchronization [None req-0bd6aafb-dbc7-4624-9229-5587f8825709 tempest-ServersTestManualDisk-62724510 tempest-ServersTestManualDisk-62724510-project-member] Enqueued Resource ID: 336e562f-9c8e-4021-953e-5756518b10b0 with Priority: HIGHEST for action security_group_rules [ 694.761223] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 336e562f-9c8e-4021-953e-5756518b10b0 with Priority: HIGHEST for action security_group_rules [ 694.761535] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-336e562f-9c8e-4021-953e-5756518b10b0 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.761629] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-336e562f-9c8e-4021-953e-5756518b10b0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.761666] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-336e562f-9c8e-4021-953e-5756518b10b0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.762531] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-336e562f-9c8e-4021-953e-5756518b10b0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.762531] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('336e562f-9c8e-4021-953e-5756518b10b0',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.919113] env[70614]: INFO networking_nsxv3.common.synchronization [None req-a8f07322-c84a-4189-a864-2803b0bb978c tempest-ServersTestManualDisk-62724510 tempest-ServersTestManualDisk-62724510-project-member] Enqueued Resource ID: 336e562f-9c8e-4021-953e-5756518b10b0 with Priority: HIGHEST for action security_group_rules [ 694.919795] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 336e562f-9c8e-4021-953e-5756518b10b0 with Priority: HIGHEST for action security_group_rules [ 694.920309] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-336e562f-9c8e-4021-953e-5756518b10b0 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.920450] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-336e562f-9c8e-4021-953e-5756518b10b0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.290103] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.290331] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.290331] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.290582] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.290704] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.290832] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 336e562f-9c8e-4021-953e-5756518b10b0 already deleted. [ 695.290944] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-336e562f-9c8e-4021-953e-5756518b10b0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.291123] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-336e562f-9c8e-4021-953e-5756518b10b0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.291295] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-336e562f-9c8e-4021-953e-5756518b10b0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.291384] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('336e562f-9c8e-4021-953e-5756518b10b0',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.794901] env[70614]: INFO networking_nsxv3.common.synchronization [None req-81c70249-ed4f-46bc-a8c9-cf8c665a7505 None None] Enqueued Resource ID: 3ab10e73-69cd-4f8d-a57a-080bbdc47db4 with Priority: HIGHEST for action port [ 695.796376] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ab10e73-69cd-4f8d-a57a-080bbdc47db4 with Priority: HIGHEST for action port [ 695.796934] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ab10e73-69cd-4f8d-a57a-080bbdc47db4 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.796934] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ab10e73-69cd-4f8d-a57a-080bbdc47db4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.797175] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ab10e73-69cd-4f8d-a57a-080bbdc47db4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.798186] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ab10e73-69cd-4f8d-a57a-080bbdc47db4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.798186] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ab10e73-69cd-4f8d-a57a-080bbdc47db4',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.816141] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.816304] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.816414] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.816751] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.816857] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.816958] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 336e562f-9c8e-4021-953e-5756518b10b0 already deleted. [ 695.817055] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-336e562f-9c8e-4021-953e-5756518b10b0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.302416] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3ab10e73-69cd-4f8d-a57a-080bbdc47db4 [ 696.302731] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.303149] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.303149] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.303149] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.303149] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.304257] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3ab10e73-69cd-4f8d-a57a-080bbdc47db4 already deleted. [ 696.304257] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ab10e73-69cd-4f8d-a57a-080bbdc47db4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.391497] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b in Status: SUCCESS [ 696.391723] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.391922] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.392170] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.392706] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.392706] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.392706] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.392909] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.392909] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.392909] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.393075] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.394347] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.395169] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.395349] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.395474] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.395542] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.395696] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.395782] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.395876] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.898604] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.899482] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.902494] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.955940] env[70614]: INFO networking_nsxv3.common.synchronization [req-34579121-ed88-438f-9850-b17506507a2b req-dcfa05e7-c3ce-4082-aaa9-2a495183bfdc tempest-ListImageFiltersTestJSON-737813167 tempest-ListImageFiltersTestJSON-737813167-project-member] Enqueued Resource ID: f21a3b6e-da5e-4c92-8717-c114952a5767 with Priority: HIGHEST for action security_group_members [ 696.956480] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f21a3b6e-da5e-4c92-8717-c114952a5767 with Priority: HIGHEST for action security_group_members [ 696.956821] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-f21a3b6e-da5e-4c92-8717-c114952a5767 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.956997] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f21a3b6e-da5e-4c92-8717-c114952a5767" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.957191] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f21a3b6e-da5e-4c92-8717-c114952a5767" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.957572] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f21a3b6e-da5e-4c92-8717-c114952a5767" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.957718] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.957939] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.957939] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.958126] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.958266] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.958395] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f21a3b6e-da5e-4c92-8717-c114952a5767',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.405446] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.463277] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.463277] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.463277] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.463445] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.463565] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.464396] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.464396] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.464396] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.464396] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.464396] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.464653] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f21a3b6e-da5e-4c92-8717-c114952a5767 already deleted. [ 697.464653] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f21a3b6e-da5e-4c92-8717-c114952a5767" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.911325] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.911325] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.911325] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.911325] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.911325] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.911325] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b is going to be updated. [ 697.948333] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.948333] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.948333] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.948333] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.948333] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.959497] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b in Status: IN_PROGRESS for 2s [ 698.034439] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-573 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.034650] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-573" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.034786] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-573" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.035082] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-573" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.035333] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.035505] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.035634] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.035845] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.035982] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.036268] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 698.036403] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 698.036525] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 698.036630] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 698.036859] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 698.037026] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 698.037193] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 698.062908] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 698.063131] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 698.063278] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 698.063488] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-573" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.063940] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-a6d704d7-ecba-4c6d-a3cd-27d99518ab79 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.064170] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-a6d704d7-ecba-4c6d-a3cd-27d99518ab79" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.064328] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-a6d704d7-ecba-4c6d-a3cd-27d99518ab79" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.064864] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-a6d704d7-ecba-4c6d-a3cd-27d99518ab79" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.065183] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6d704d7-ecba-4c6d-a3cd-27d99518ab79',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.254390] env[70614]: INFO networking_nsxv3.common.synchronization [None req-e8fa4fdf-5d66-4fe4-ad50-c6636228c014 None None] Enqueued Resource ID: 43c0709a-5a68-496c-9d00-856fabd8eee9 with Priority: HIGHEST for action port [ 698.255020] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43c0709a-5a68-496c-9d00-856fabd8eee9 with Priority: HIGHEST for action port [ 698.255395] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-43c0709a-5a68-496c-9d00-856fabd8eee9 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.255531] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-43c0709a-5a68-496c-9d00-856fabd8eee9" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.255591] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-43c0709a-5a68-496c-9d00-856fabd8eee9" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.255927] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-43c0709a-5a68-496c-9d00-856fabd8eee9" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.255927] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43c0709a-5a68-496c-9d00-856fabd8eee9',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.567511] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.567824] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.568060] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.568359] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.568515] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.568770] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port a6d704d7-ecba-4c6d-a3cd-27d99518ab79 not found, creating... [ 698.568970] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.569148] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.569262] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.569478] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.569613] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.569888] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.571797] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.571971] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.572220] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.572361] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.572508] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: a6d704d7-ecba-4c6d-a3cd-27d99518ab79 is going to be created. [ 698.597640] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.598743] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.598936] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.599312] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.600673] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.600823] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-a6d704d7-ecba-4c6d-a3cd-27d99518ab79" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.760068] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 43c0709a-5a68-496c-9d00-856fabd8eee9 [ 698.760321] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.760461] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.760527] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.760740] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.760981] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.760981] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:43c0709a-5a68-496c-9d00-856fabd8eee9 already deleted. [ 698.760981] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-43c0709a-5a68-496c-9d00-856fabd8eee9" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.133197] env[70614]: INFO networking_nsxv3.common.synchronization [req-65d7d16f-db23-45ce-9736-7942f7088316 req-22985ce7-3cd3-4d74-bf26-54f6018bdfc3 tempest-ListImageFiltersTestJSON-737813167 tempest-ListImageFiltersTestJSON-737813167-project-member] Enqueued Resource ID: f21a3b6e-da5e-4c92-8717-c114952a5767 with Priority: HIGHEST for action security_group_members [ 699.133197] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f21a3b6e-da5e-4c92-8717-c114952a5767 with Priority: HIGHEST for action security_group_members [ 699.133197] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-f21a3b6e-da5e-4c92-8717-c114952a5767 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.133197] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f21a3b6e-da5e-4c92-8717-c114952a5767" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.133693] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f21a3b6e-da5e-4c92-8717-c114952a5767" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.134039] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f21a3b6e-da5e-4c92-8717-c114952a5767" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.135032] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.135032] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.135032] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.135032] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.135032] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.135032] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f21a3b6e-da5e-4c92-8717-c114952a5767',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.641225] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.641225] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.641225] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.641698] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.641698] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.641698] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.641698] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.641861] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.642916] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.642916] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.642916] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f21a3b6e-da5e-4c92-8717-c114952a5767 already deleted. [ 699.642916] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f21a3b6e-da5e-4c92-8717-c114952a5767" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.764803] env[70614]: INFO networking_nsxv3.common.synchronization [req-3057c268-87b2-42ac-bde6-6770a2fd2bc2 req-61ddce3c-051d-475a-8aef-87a9ee007f74 tempest-InstanceActionsNegativeTestJSON-1887447034 tempest-InstanceActionsNegativeTestJSON-1887447034-project-member] Enqueued Resource ID: 954d5d18-f5f4-41ee-a496-48e087a4b527 with Priority: HIGHEST for action security_group_members [ 699.766812] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 954d5d18-f5f4-41ee-a496-48e087a4b527 with Priority: HIGHEST for action security_group_members [ 699.769296] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-954d5d18-f5f4-41ee-a496-48e087a4b527 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.769531] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-954d5d18-f5f4-41ee-a496-48e087a4b527" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.769613] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-954d5d18-f5f4-41ee-a496-48e087a4b527" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.769901] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-954d5d18-f5f4-41ee-a496-48e087a4b527" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.770332] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.770516] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.770616] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.770826] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.770963] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.771118] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('954d5d18-f5f4-41ee-a496-48e087a4b527',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.905316] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-573 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.905961] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-573" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.905961] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-573" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.905961] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-573" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.906273] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.907437] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.907622] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.907877] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.908037] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.908320] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 699.908387] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 699.908452] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 699.908566] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 699.908676] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 699.908747] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 699.911020] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 699.936581] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 699.936581] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 699.936581] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 699.936581] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-573" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.936581] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-7620e346-6e01-4936-a47b-8c3e3c12860d taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.936581] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-7620e346-6e01-4936-a47b-8c3e3c12860d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.936581] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-7620e346-6e01-4936-a47b-8c3e3c12860d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.936581] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-7620e346-6e01-4936-a47b-8c3e3c12860d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.936581] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7620e346-6e01-4936-a47b-8c3e3c12860d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.969376] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b in Status: SUCCESS [ 699.969606] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.970145] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.970404] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.970618] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.970755] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.970840] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.971161] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.971257] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.973042] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.973042] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.973042] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.973042] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.973042] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.973042] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.973042] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.973042] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.973042] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.973042] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.973495] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.973495] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.208361] env[70614]: INFO networking_nsxv3.common.synchronization [req-34579121-ed88-438f-9850-b17506507a2b req-c647e9e3-62d1-4759-bd35-bb9a501a3447 service nova] Enqueued Resource ID: f21a3b6e-da5e-4c92-8717-c114952a5767 with Priority: HIGHEST for action security_group_rules [ 700.208361] env[70614]: INFO networking_nsxv3.common.synchronization [req-34579121-ed88-438f-9850-b17506507a2b req-c647e9e3-62d1-4759-bd35-bb9a501a3447 service nova] Enqueued Resource ID: f21a3b6e-da5e-4c92-8717-c114952a5767 with Priority: HIGHEST for action security_group_members [ 700.208361] env[70614]: INFO networking_nsxv3.common.synchronization [req-34579121-ed88-438f-9850-b17506507a2b req-c647e9e3-62d1-4759-bd35-bb9a501a3447 service nova] Enqueued Resource ID: a6d704d7-ecba-4c6d-a3cd-27d99518ab79 with Priority: HIGHEST for action port [ 700.208361] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f21a3b6e-da5e-4c92-8717-c114952a5767 with Priority: HIGHEST for action security_group_rules [ 700.208361] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f21a3b6e-da5e-4c92-8717-c114952a5767 with Priority: HIGHEST for action security_group_members [ 700.208361] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6d704d7-ecba-4c6d-a3cd-27d99518ab79 with Priority: HIGHEST for action port [ 700.208361] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f21a3b6e-da5e-4c92-8717-c114952a5767 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.208361] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f21a3b6e-da5e-4c92-8717-c114952a5767" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.208361] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f21a3b6e-da5e-4c92-8717-c114952a5767" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.208361] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f21a3b6e-da5e-4c92-8717-c114952a5767" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.208361] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f21a3b6e-da5e-4c92-8717-c114952a5767',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.210713] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-f21a3b6e-da5e-4c92-8717-c114952a5767 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.211209] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f21a3b6e-da5e-4c92-8717-c114952a5767" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.211399] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f21a3b6e-da5e-4c92-8717-c114952a5767" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.212923] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f21a3b6e-da5e-4c92-8717-c114952a5767" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.212923] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.212923] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.212923] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.212923] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.212923] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.212923] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f21a3b6e-da5e-4c92-8717-c114952a5767',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.214981] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-a6d704d7-ecba-4c6d-a3cd-27d99518ab79 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.214981] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a6d704d7-ecba-4c6d-a3cd-27d99518ab79" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.214981] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a6d704d7-ecba-4c6d-a3cd-27d99518ab79" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.214981] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a6d704d7-ecba-4c6d-a3cd-27d99518ab79" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.214981] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6d704d7-ecba-4c6d-a3cd-27d99518ab79',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.274029] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.274490] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.274577] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.274840] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.274958] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.275197] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.275295] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.275295] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.276386] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.276386] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.276386] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 954d5d18-f5f4-41ee-a496-48e087a4b527 is going to be updated. [ 700.309527] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.309680] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.309739] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.309950] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.310133] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.319883] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 954d5d18-f5f4-41ee-a496-48e087a4b527 in Status: IN_PROGRESS for 2s [ 700.439462] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.439695] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.439895] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.440329] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.440329] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.440461] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 7620e346-6e01-4936-a47b-8c3e3c12860d not found, creating... [ 700.440648] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.440900] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.440946] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.441940] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.441940] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.441940] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.441940] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.441940] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.444240] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.444240] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.444240] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 7620e346-6e01-4936-a47b-8c3e3c12860d is going to be created. [ 700.468522] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.468749] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.468898] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.469239] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.469433] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.469681] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-7620e346-6e01-4936-a47b-8c3e3c12860d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.475254] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b: rpc.has_security_group_logging(os_id): False [ 700.499766] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.500098] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.500098] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.500227] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.500313] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.500540] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.500730] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.500730] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.500929] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.500929] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.501079] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.501170] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.502071] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.502414] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.502511] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.502763] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.502985] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.502985] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.503252] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.503323] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.503383] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b is going to be created. [ 700.606550] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.606550] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.606550] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.608031] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.608031] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.622363] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b in Status: IN_PROGRESS for 2s [ 700.716057] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-f21a3b6e-da5e-4c92-8717-c114952a5767 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.716213] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f21a3b6e-da5e-4c92-8717-c114952a5767" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.716441] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f21a3b6e-da5e-4c92-8717-c114952a5767',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.717580] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a6d704d7-ecba-4c6d-a3cd-27d99518ab79 with status ACTIVE [ 700.717677] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.717776] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.717837] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.718102] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.718221] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.718486] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.718550] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.718594] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.718754] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.718899] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.719783] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.719926] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.720019] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.720214] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.720286] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.720392] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a6d704d7-ecba-4c6d-a3cd-27d99518ab79 is going to be updated. [ 700.760836] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.760836] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.760836] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.761121] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.761283] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.761457] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a6d704d7-ecba-4c6d-a3cd-27d99518ab79" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.162765] env[70614]: INFO networking_nsxv3.common.synchronization [None req-3d6ed1b7-0668-45d1-890d-e7523c883dbf None None] Enqueued Resource ID: d79a48e5-6fe9-44c5-9773-f8ab2aed538a with Priority: HIGHEST for action port [ 701.162924] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d79a48e5-6fe9-44c5-9773-f8ab2aed538a with Priority: HIGHEST for action port [ 701.164173] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-d79a48e5-6fe9-44c5-9773-f8ab2aed538a taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.164173] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d79a48e5-6fe9-44c5-9773-f8ab2aed538a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.164173] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d79a48e5-6fe9-44c5-9773-f8ab2aed538a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.164173] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d79a48e5-6fe9-44c5-9773-f8ab2aed538a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.164173] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d79a48e5-6fe9-44c5-9773-f8ab2aed538a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.223454] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f21a3b6e-da5e-4c92-8717-c114952a5767',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.263104] env[70614]: INFO networking_nsxv3.common.synchronization [req-65d7d16f-db23-45ce-9736-7942f7088316 req-24ddeb96-c7a0-43ef-bf7a-4f0bff1d8731 service nova] Enqueued Resource ID: f21a3b6e-da5e-4c92-8717-c114952a5767 with Priority: HIGHEST for action security_group_rules [ 701.263279] env[70614]: INFO networking_nsxv3.common.synchronization [req-65d7d16f-db23-45ce-9736-7942f7088316 req-24ddeb96-c7a0-43ef-bf7a-4f0bff1d8731 service nova] Enqueued Resource ID: f21a3b6e-da5e-4c92-8717-c114952a5767 with Priority: HIGHEST for action security_group_members [ 701.263413] env[70614]: INFO networking_nsxv3.common.synchronization [req-65d7d16f-db23-45ce-9736-7942f7088316 req-24ddeb96-c7a0-43ef-bf7a-4f0bff1d8731 service nova] Enqueued Resource ID: 7620e346-6e01-4936-a47b-8c3e3c12860d with Priority: HIGHEST for action port [ 701.263950] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f21a3b6e-da5e-4c92-8717-c114952a5767 with Priority: HIGHEST for action security_group_rules [ 701.264425] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f21a3b6e-da5e-4c92-8717-c114952a5767 with Priority: HIGHEST for action security_group_members [ 701.264425] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7620e346-6e01-4936-a47b-8c3e3c12860d with Priority: HIGHEST for action port [ 701.264537] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f21a3b6e-da5e-4c92-8717-c114952a5767 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.264599] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f21a3b6e-da5e-4c92-8717-c114952a5767" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.264813] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-f21a3b6e-da5e-4c92-8717-c114952a5767 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.264892] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f21a3b6e-da5e-4c92-8717-c114952a5767" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.265215] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-7620e346-6e01-4936-a47b-8c3e3c12860d taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.265325] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7620e346-6e01-4936-a47b-8c3e3c12860d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.265386] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7620e346-6e01-4936-a47b-8c3e3c12860d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.265611] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7620e346-6e01-4936-a47b-8c3e3c12860d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.265687] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7620e346-6e01-4936-a47b-8c3e3c12860d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.674050] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d79a48e5-6fe9-44c5-9773-f8ab2aed538a [ 701.674050] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.674050] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.674050] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.674050] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.674398] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.674398] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d79a48e5-6fe9-44c5-9773-f8ab2aed538a already deleted. [ 701.674398] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d79a48e5-6fe9-44c5-9773-f8ab2aed538a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.726957] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.727203] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.727330] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.727555] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.727612] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.727689] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f21a3b6e-da5e-4c92-8717-c114952a5767 is going to be created. [ 701.762946] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.763158] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.763294] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.763553] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.763797] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.767673] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7620e346-6e01-4936-a47b-8c3e3c12860d with status ACTIVE [ 701.767965] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.768078] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.768852] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.768852] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.768852] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.768852] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.768852] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.770289] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.770463] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.770908] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.771409] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.771777] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.772080] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.772466] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.773720] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.773720] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7620e346-6e01-4936-a47b-8c3e3c12860d is going to be updated. [ 701.779165] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f21a3b6e-da5e-4c92-8717-c114952a5767 in Status: UNINITIALIZED for 2s [ 701.803025] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.803025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.803025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.803025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.803025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.803025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7620e346-6e01-4936-a47b-8c3e3c12860d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.331753] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 954d5d18-f5f4-41ee-a496-48e087a4b527 in Status: SUCCESS [ 702.332069] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 954d5d18-f5f4-41ee-a496-48e087a4b527 deletion is rescheduled due to dependency. [ 702.332069] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-954d5d18-f5f4-41ee-a496-48e087a4b527" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.635117] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b in Status: SUCCESS [ 702.635317] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.635508] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.635676] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.635772] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.138451] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.138451] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.138451] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.138718] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.138825] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.138913] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.138973] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.140923] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.140923] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.140923] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.140923] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.644588] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.644975] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.644975] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.645232] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.645829] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.645991] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.646052] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.646203] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.646291] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.646393] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.646547] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.646639] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.646696] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.646951] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.647177] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.647251] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.647290] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.647439] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.647526] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.647608] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.647699] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.790102] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f21a3b6e-da5e-4c92-8717-c114952a5767 in Status: SUCCESS [ 703.790495] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f21a3b6e-da5e-4c92-8717-c114952a5767" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.791044] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f21a3b6e-da5e-4c92-8717-c114952a5767" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.791267] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f21a3b6e-da5e-4c92-8717-c114952a5767" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.791458] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.791652] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.791652] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.791788] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.791870] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.791955] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f21a3b6e-da5e-4c92-8717-c114952a5767" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.792067] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f21a3b6e-da5e-4c92-8717-c114952a5767',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.792872] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f21a3b6e-da5e-4c92-8717-c114952a5767" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.793160] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f21a3b6e-da5e-4c92-8717-c114952a5767" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.793393] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.793493] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.793617] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.793754] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.793933] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.793979] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f21a3b6e-da5e-4c92-8717-c114952a5767',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.150321] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b: rpc.has_security_group_logging(os_id): False [ 704.170421] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.170840] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.170945] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.172275] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.172386] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.172535] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.172645] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.172712] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.172897] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.172977] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.173398] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.173398] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.173398] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.173551] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.173551] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.174621] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.174823] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.174915] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.175094] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.175175] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.175263] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b is going to be updated. [ 704.245169] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.245169] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.245169] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.245169] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.245169] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.260026] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b in Status: IN_PROGRESS for 2s [ 704.296789] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-f21a3b6e-da5e-4c92-8717-c114952a5767 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.297023] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f21a3b6e-da5e-4c92-8717-c114952a5767" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.298283] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f21a3b6e-da5e-4c92-8717-c114952a5767',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.430320] env[70614]: INFO networking_nsxv3.common.synchronization [req-cc5c4d7a-c45e-4723-8214-60609ae09cc3 req-abcae970-1b90-4e9f-9bc1-828c752fff9c tempest-ImagesNegativeTestJSON-981052346 tempest-ImagesNegativeTestJSON-981052346-project-member] Enqueued Resource ID: 0d6e05da-2389-460c-a38a-c95fe0a87162 with Priority: HIGHEST for action security_group_members [ 704.430320] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d6e05da-2389-460c-a38a-c95fe0a87162 with Priority: HIGHEST for action security_group_members [ 704.430320] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d6e05da-2389-460c-a38a-c95fe0a87162 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.430320] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d6e05da-2389-460c-a38a-c95fe0a87162" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.430320] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d6e05da-2389-460c-a38a-c95fe0a87162" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.431253] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d6e05da-2389-460c-a38a-c95fe0a87162" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.431515] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.432315] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.432315] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.432315] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.434307] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.435655] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d6e05da-2389-460c-a38a-c95fe0a87162',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.804033] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f21a3b6e-da5e-4c92-8717-c114952a5767',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.904069] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-705 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.904290] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-705" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.904410] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-705" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.904792] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-705" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.905056] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.905223] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.905340] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.905561] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.905703] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.905913] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 704.906038] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 704.906148] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 704.906306] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 704.909955] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 704.910059] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 704.910150] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 704.931744] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 704.931891] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 704.932080] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 704.932283] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-705" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.932621] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-99ac559e-a87a-46d6-8e9a-35fee4dde83a taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.932836] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-99ac559e-a87a-46d6-8e9a-35fee4dde83a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.932967] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-99ac559e-a87a-46d6-8e9a-35fee4dde83a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.933394] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-99ac559e-a87a-46d6-8e9a-35fee4dde83a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.933546] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99ac559e-a87a-46d6-8e9a-35fee4dde83a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.939077] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.939331] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.939331] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.939551] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.939615] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.939810] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.939945] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.940047] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.940127] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.940204] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.940291] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d6e05da-2389-460c-a38a-c95fe0a87162 already deleted. [ 704.940371] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d6e05da-2389-460c-a38a-c95fe0a87162" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.312145] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.312145] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.312145] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.313272] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.314564] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.314564] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f21a3b6e-da5e-4c92-8717-c114952a5767 is going to be updated. [ 705.349296] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.349296] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.349296] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.349296] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.349296] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.360093] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f21a3b6e-da5e-4c92-8717-c114952a5767 in Status: IN_PROGRESS for 2s [ 705.437666] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.437666] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.437666] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.438169] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.438169] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.438305] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 99ac559e-a87a-46d6-8e9a-35fee4dde83a not found, creating... [ 705.438586] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.438798] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.438933] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.439209] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.439449] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.439715] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.439898] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.440022] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.440451] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.440614] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.440762] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 99ac559e-a87a-46d6-8e9a-35fee4dde83a is going to be created. [ 705.467755] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.467984] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.468142] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.468441] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.468681] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.468932] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-99ac559e-a87a-46d6-8e9a-35fee4dde83a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.280066] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b in Status: SUCCESS [ 706.280520] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.503376] env[70614]: INFO networking_nsxv3.common.synchronization [req-cc5c4d7a-c45e-4723-8214-60609ae09cc3 req-24a92222-bb70-4dc5-9c60-5f7b236f7f2d service nova] Enqueued Resource ID: 0d6e05da-2389-460c-a38a-c95fe0a87162 with Priority: HIGHEST for action security_group_rules [ 706.503376] env[70614]: INFO networking_nsxv3.common.synchronization [req-cc5c4d7a-c45e-4723-8214-60609ae09cc3 req-24a92222-bb70-4dc5-9c60-5f7b236f7f2d service nova] Enqueued Resource ID: 0d6e05da-2389-460c-a38a-c95fe0a87162 with Priority: HIGHEST for action security_group_members [ 706.503376] env[70614]: INFO networking_nsxv3.common.synchronization [req-cc5c4d7a-c45e-4723-8214-60609ae09cc3 req-24a92222-bb70-4dc5-9c60-5f7b236f7f2d service nova] Enqueued Resource ID: 99ac559e-a87a-46d6-8e9a-35fee4dde83a with Priority: HIGHEST for action port [ 706.503376] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d6e05da-2389-460c-a38a-c95fe0a87162 with Priority: HIGHEST for action security_group_rules [ 706.504071] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d6e05da-2389-460c-a38a-c95fe0a87162 with Priority: HIGHEST for action security_group_members [ 706.504237] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99ac559e-a87a-46d6-8e9a-35fee4dde83a with Priority: HIGHEST for action port [ 706.504553] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0d6e05da-2389-460c-a38a-c95fe0a87162 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.504716] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0d6e05da-2389-460c-a38a-c95fe0a87162" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.504804] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0d6e05da-2389-460c-a38a-c95fe0a87162" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.505134] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0d6e05da-2389-460c-a38a-c95fe0a87162" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.505251] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0d6e05da-2389-460c-a38a-c95fe0a87162',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.507849] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d6e05da-2389-460c-a38a-c95fe0a87162 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.507849] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d6e05da-2389-460c-a38a-c95fe0a87162" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.507849] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d6e05da-2389-460c-a38a-c95fe0a87162" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.507849] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d6e05da-2389-460c-a38a-c95fe0a87162" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.508202] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.508202] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.508331] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.508483] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.508643] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.508785] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d6e05da-2389-460c-a38a-c95fe0a87162',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.509865] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-99ac559e-a87a-46d6-8e9a-35fee4dde83a taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.509865] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-99ac559e-a87a-46d6-8e9a-35fee4dde83a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.510067] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-99ac559e-a87a-46d6-8e9a-35fee4dde83a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.510067] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-99ac559e-a87a-46d6-8e9a-35fee4dde83a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.510163] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99ac559e-a87a-46d6-8e9a-35fee4dde83a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.014017] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d6e05da-2389-460c-a38a-c95fe0a87162 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.014017] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d6e05da-2389-460c-a38a-c95fe0a87162" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.014017] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 99ac559e-a87a-46d6-8e9a-35fee4dde83a with status ACTIVE [ 707.014017] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.014017] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.014017] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.014017] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.014017] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.014474] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.014474] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.014474] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.014474] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.014637] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.014821] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.014912] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.015039] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.015143] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.015213] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.015296] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 99ac559e-a87a-46d6-8e9a-35fee4dde83a is going to be updated. [ 707.017055] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0d6e05da-2389-460c-a38a-c95fe0a87162',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.047218] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.047396] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.047471] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.047683] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.047819] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.047987] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-99ac559e-a87a-46d6-8e9a-35fee4dde83a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.377958] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f21a3b6e-da5e-4c92-8717-c114952a5767 in Status: SUCCESS [ 707.378401] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f21a3b6e-da5e-4c92-8717-c114952a5767" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.378401] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f21a3b6e-da5e-4c92-8717-c114952a5767" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.378678] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f21a3b6e-da5e-4c92-8717-c114952a5767" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.378865] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.378991] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.379105] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.379259] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.379325] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.379386] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f21a3b6e-da5e-4c92-8717-c114952a5767" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.380197] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-f21a3b6e-da5e-4c92-8717-c114952a5767 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.380197] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f21a3b6e-da5e-4c92-8717-c114952a5767" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.380197] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f21a3b6e-da5e-4c92-8717-c114952a5767" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.380197] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f21a3b6e-da5e-4c92-8717-c114952a5767" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.380197] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.380827] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.380921] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.381122] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.381204] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.381357] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f21a3b6e-da5e-4c92-8717-c114952a5767" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.381464] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f21a3b6e-da5e-4c92-8717-c114952a5767',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.517031] env[70614]: INFO networking_nsxv3.common.synchronization [req-e349e329-ea07-42c4-881d-fa0883dab8c8 req-a406998b-7819-4571-a797-e8851f0963f7 tempest-FloatingIPsAssociationTestJSON-514222769 tempest-FloatingIPsAssociationTestJSON-514222769-project-member] Enqueued Resource ID: f0060547-03fb-4d1a-ad8e-69519760b908 with Priority: HIGHEST for action security_group_members [ 707.517988] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0060547-03fb-4d1a-ad8e-69519760b908 with Priority: HIGHEST for action security_group_members [ 707.518773] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0060547-03fb-4d1a-ad8e-69519760b908 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.519654] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0060547-03fb-4d1a-ad8e-69519760b908" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.519654] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0060547-03fb-4d1a-ad8e-69519760b908" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.520503] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0060547-03fb-4d1a-ad8e-69519760b908" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.520503] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.520503] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.520503] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.520503] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.520503] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.520503] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0060547-03fb-4d1a-ad8e-69519760b908',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.524028] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0d6e05da-2389-460c-a38a-c95fe0a87162',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.607257] env[70614]: INFO networking_nsxv3.common.synchronization [None req-5e3e9b5c-9182-4851-aff9-912e2db82cd8 None None] Enqueued Resource ID: 3f71e428-2704-47ea-9507-3e6f04a66105 with Priority: HIGHEST for action port [ 707.609165] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f71e428-2704-47ea-9507-3e6f04a66105 with Priority: HIGHEST for action port [ 707.610564] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-3f71e428-2704-47ea-9507-3e6f04a66105 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.612523] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3f71e428-2704-47ea-9507-3e6f04a66105" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.612523] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3f71e428-2704-47ea-9507-3e6f04a66105" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.612523] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3f71e428-2704-47ea-9507-3e6f04a66105" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.612523] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f71e428-2704-47ea-9507-3e6f04a66105',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.885116] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f21a3b6e-da5e-4c92-8717-c114952a5767: rpc.has_security_group_logging(os_id): False [ 707.905150] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.905150] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.905150] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.905337] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.905601] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.905762] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.905897] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.905970] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.906202] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.906295] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.906516] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.906629] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.906711] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.906918] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.906990] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.910872] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.911052] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.911114] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.911327] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.911413] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.911530] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f21a3b6e-da5e-4c92-8717-c114952a5767 is going to be created. [ 707.992613] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.992613] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.992613] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.992613] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.992613] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.005556] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f21a3b6e-da5e-4c92-8717-c114952a5767 in Status: IN_PROGRESS for 2s [ 708.023767] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f0060547-03fb-4d1a-ad8e-69519760b908',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.024794] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.028200] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.028200] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.028200] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.028200] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.028531] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d6e05da-2389-460c-a38a-c95fe0a87162 is going to be created. [ 708.101151] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.101350] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.101432] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.101625] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.101782] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.114536] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3f71e428-2704-47ea-9507-3e6f04a66105 [ 708.114774] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.114943] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.115023] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.115246] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.115331] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.115424] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3f71e428-2704-47ea-9507-3e6f04a66105 already deleted. [ 708.115502] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3f71e428-2704-47ea-9507-3e6f04a66105" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.125551] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d6e05da-2389-460c-a38a-c95fe0a87162 in Status: UNINITIALIZED for 2s [ 708.457224] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-45 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.457224] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-45" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.457224] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-45" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.457786] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-45" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.458291] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.458920] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.459207] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.459601] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.459915] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.460296] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 708.460520] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 708.460764] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 708.461331] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 708.461331] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 708.461331] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 708.461724] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 708.482392] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 708.482392] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 708.482392] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 708.482392] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-45" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.482600] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-a88c8196-849b-42fd-a7c3-675045aaf120 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.482600] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-a88c8196-849b-42fd-a7c3-675045aaf120" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.482757] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-a88c8196-849b-42fd-a7c3-675045aaf120" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.483061] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-a88c8196-849b-42fd-a7c3-675045aaf120" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.487455] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a88c8196-849b-42fd-a7c3-675045aaf120',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.525851] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f0060547-03fb-4d1a-ad8e-69519760b908',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.990765] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.991090] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.992099] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.992531] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.992673] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.992842] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port a88c8196-849b-42fd-a7c3-675045aaf120 not found, creating... [ 708.993686] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.993906] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.994057] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.994314] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.994605] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.994786] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.994952] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.995073] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.995309] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.995447] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.995590] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: a88c8196-849b-42fd-a7c3-675045aaf120 is going to be created. [ 709.021751] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.022270] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.022270] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.022463] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.022622] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.022857] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-a88c8196-849b-42fd-a7c3-675045aaf120" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.029953] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.030150] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.030195] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.030514] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.030514] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.030643] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0060547-03fb-4d1a-ad8e-69519760b908 is going to be updated. [ 709.069509] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.069509] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.069509] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.069509] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.069509] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.079066] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0060547-03fb-4d1a-ad8e-69519760b908 in Status: IN_PROGRESS for 2s [ 709.720784] env[70614]: INFO networking_nsxv3.common.synchronization [None req-67bf0825-79f7-4c99-9905-5f89828b2558 None None] Enqueued Resource ID: d4b40185-c0df-4941-b5aa-d97248a17c5a with Priority: HIGHEST for action port [ 709.722260] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4b40185-c0df-4941-b5aa-d97248a17c5a with Priority: HIGHEST for action port [ 709.722489] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-d4b40185-c0df-4941-b5aa-d97248a17c5a taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.722647] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d4b40185-c0df-4941-b5aa-d97248a17c5a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.722701] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d4b40185-c0df-4941-b5aa-d97248a17c5a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.724076] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d4b40185-c0df-4941-b5aa-d97248a17c5a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.724076] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d4b40185-c0df-4941-b5aa-d97248a17c5a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.909905] env[70614]: INFO networking_nsxv3.common.synchronization [req-e349e329-ea07-42c4-881d-fa0883dab8c8 req-8c6934b6-ad40-4044-82f6-f72ab6346c7f service nova] Enqueued Resource ID: f0060547-03fb-4d1a-ad8e-69519760b908 with Priority: HIGHEST for action security_group_rules [ 709.910154] env[70614]: INFO networking_nsxv3.common.synchronization [req-e349e329-ea07-42c4-881d-fa0883dab8c8 req-8c6934b6-ad40-4044-82f6-f72ab6346c7f service nova] Enqueued Resource ID: f0060547-03fb-4d1a-ad8e-69519760b908 with Priority: HIGHEST for action security_group_members [ 709.910343] env[70614]: INFO networking_nsxv3.common.synchronization [req-e349e329-ea07-42c4-881d-fa0883dab8c8 req-8c6934b6-ad40-4044-82f6-f72ab6346c7f service nova] Enqueued Resource ID: a88c8196-849b-42fd-a7c3-675045aaf120 with Priority: HIGHEST for action port [ 709.910535] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0060547-03fb-4d1a-ad8e-69519760b908 with Priority: HIGHEST for action security_group_rules [ 709.910733] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0060547-03fb-4d1a-ad8e-69519760b908 with Priority: HIGHEST for action security_group_members [ 709.910792] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a88c8196-849b-42fd-a7c3-675045aaf120 with Priority: HIGHEST for action port [ 709.912026] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f0060547-03fb-4d1a-ad8e-69519760b908 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.912249] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f0060547-03fb-4d1a-ad8e-69519760b908" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.912249] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f0060547-03fb-4d1a-ad8e-69519760b908" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.912574] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f0060547-03fb-4d1a-ad8e-69519760b908" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.912574] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f0060547-03fb-4d1a-ad8e-69519760b908',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.913900] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0060547-03fb-4d1a-ad8e-69519760b908 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.914137] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0060547-03fb-4d1a-ad8e-69519760b908" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.914385] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-a88c8196-849b-42fd-a7c3-675045aaf120 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.914491] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a88c8196-849b-42fd-a7c3-675045aaf120" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.914597] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a88c8196-849b-42fd-a7c3-675045aaf120" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.915104] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a88c8196-849b-42fd-a7c3-675045aaf120" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.915104] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a88c8196-849b-42fd-a7c3-675045aaf120',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.020169] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f21a3b6e-da5e-4c92-8717-c114952a5767 in Status: SUCCESS [ 710.020974] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f21a3b6e-da5e-4c92-8717-c114952a5767" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.020974] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f21a3b6e-da5e-4c92-8717-c114952a5767" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.020974] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f21a3b6e-da5e-4c92-8717-c114952a5767" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.020974] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f21a3b6e-da5e-4c92-8717-c114952a5767',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.138647] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d6e05da-2389-460c-a38a-c95fe0a87162 in Status: UNINITIALIZED for 4s [ 710.228707] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d4b40185-c0df-4941-b5aa-d97248a17c5a [ 710.228707] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.229285] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.229285] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.229720] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.229928] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.230115] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d4b40185-c0df-4941-b5aa-d97248a17c5a already deleted. [ 710.230256] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d4b40185-c0df-4941-b5aa-d97248a17c5a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.420230] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0060547-03fb-4d1a-ad8e-69519760b908 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.420230] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0060547-03fb-4d1a-ad8e-69519760b908" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.420230] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a88c8196-849b-42fd-a7c3-675045aaf120 with status ACTIVE [ 710.420230] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.420230] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.420230] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.421200] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.421200] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.421200] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.421200] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.421200] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.421200] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.421200] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.422508] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.422508] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.422508] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.422508] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.422508] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.422508] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a88c8196-849b-42fd-a7c3-675045aaf120 is going to be updated. [ 710.451216] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.451216] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.451216] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.451216] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.451216] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.451216] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a88c8196-849b-42fd-a7c3-675045aaf120" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.526052] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-f21a3b6e-da5e-4c92-8717-c114952a5767 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.526052] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f21a3b6e-da5e-4c92-8717-c114952a5767" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.526052] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f21a3b6e-da5e-4c92-8717-c114952a5767" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.526052] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f21a3b6e-da5e-4c92-8717-c114952a5767" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.526052] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.526052] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.526052] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.526052] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.526052] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.526052] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f21a3b6e-da5e-4c92-8717-c114952a5767" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.526052] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f21a3b6e-da5e-4c92-8717-c114952a5767',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.030118] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-f21a3b6e-da5e-4c92-8717-c114952a5767 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.030452] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f21a3b6e-da5e-4c92-8717-c114952a5767" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.030452] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f21a3b6e-da5e-4c92-8717-c114952a5767" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.030617] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f21a3b6e-da5e-4c92-8717-c114952a5767" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.030793] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.030908] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.030977] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.031145] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.031235] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.031324] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f21a3b6e-da5e-4c92-8717-c114952a5767" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.031472] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-f21a3b6e-da5e-4c92-8717-c114952a5767 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.031568] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f21a3b6e-da5e-4c92-8717-c114952a5767" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.031632] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f21a3b6e-da5e-4c92-8717-c114952a5767" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.031773] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f21a3b6e-da5e-4c92-8717-c114952a5767" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.031903] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.031995] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.032069] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.032270] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.032270] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.032365] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f21a3b6e-da5e-4c92-8717-c114952a5767" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.032430] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f21a3b6e-da5e-4c92-8717-c114952a5767',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.090249] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0060547-03fb-4d1a-ad8e-69519760b908 in Status: SUCCESS [ 711.090517] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0060547-03fb-4d1a-ad8e-69519760b908" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.090616] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0060547-03fb-4d1a-ad8e-69519760b908" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.090869] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0060547-03fb-4d1a-ad8e-69519760b908" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.091075] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.091240] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.091350] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.091546] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.091634] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.091770] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0060547-03fb-4d1a-ad8e-69519760b908',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.536441] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f21a3b6e-da5e-4c92-8717-c114952a5767: rpc.has_security_group_logging(os_id): False [ 711.555890] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.556167] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.556284] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.556543] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.556724] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.557071] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.557237] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.557342] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.557571] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.557693] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.557967] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.558380] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.558380] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.558380] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.558526] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.558806] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.559044] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.559260] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.559433] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.559486] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.559595] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f21a3b6e-da5e-4c92-8717-c114952a5767 is going to be updated. [ 711.594617] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f0060547-03fb-4d1a-ad8e-69519760b908',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.628029] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.628029] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.628029] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.628029] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.628029] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.642043] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f21a3b6e-da5e-4c92-8717-c114952a5767 in Status: IN_PROGRESS for 2s [ 712.101386] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f0060547-03fb-4d1a-ad8e-69519760b908',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.157546] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d6e05da-2389-460c-a38a-c95fe0a87162 in Status: SUCCESS [ 712.157759] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d6e05da-2389-460c-a38a-c95fe0a87162" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.158133] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d6e05da-2389-460c-a38a-c95fe0a87162" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.158354] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d6e05da-2389-460c-a38a-c95fe0a87162" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.158609] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.158781] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.158893] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.159997] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.161251] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.161251] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d6e05da-2389-460c-a38a-c95fe0a87162" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.161251] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0d6e05da-2389-460c-a38a-c95fe0a87162',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.603571] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.603908] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.604091] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.604526] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.604777] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.605923] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0060547-03fb-4d1a-ad8e-69519760b908 is going to be updated. [ 712.657447] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.657725] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.659188] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.659576] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.659759] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.663919] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d6e05da-2389-460c-a38a-c95fe0a87162 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.664159] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d6e05da-2389-460c-a38a-c95fe0a87162" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.664208] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d6e05da-2389-460c-a38a-c95fe0a87162" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.664474] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d6e05da-2389-460c-a38a-c95fe0a87162" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.664666] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.664843] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.664914] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.665111] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.665340] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.665419] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d6e05da-2389-460c-a38a-c95fe0a87162" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.665616] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d6e05da-2389-460c-a38a-c95fe0a87162 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.665768] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d6e05da-2389-460c-a38a-c95fe0a87162" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.665852] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d6e05da-2389-460c-a38a-c95fe0a87162" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.666034] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d6e05da-2389-460c-a38a-c95fe0a87162" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.666224] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.666340] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.666425] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.666650] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.666760] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.666906] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d6e05da-2389-460c-a38a-c95fe0a87162" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.667060] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0d6e05da-2389-460c-a38a-c95fe0a87162',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.674045] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0060547-03fb-4d1a-ad8e-69519760b908 in Status: IN_PROGRESS for 2s [ 712.746278] env[70614]: INFO networking_nsxv3.common.synchronization [None req-6542de48-5870-4f9d-a869-9f6faa11240c None None] Enqueued Resource ID: d41be0ec-0f74-469b-a2be-b56a0721afb2 with Priority: HIGHEST for action port [ 712.746544] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d41be0ec-0f74-469b-a2be-b56a0721afb2 with Priority: HIGHEST for action port [ 712.747860] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-d41be0ec-0f74-469b-a2be-b56a0721afb2 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.747860] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d41be0ec-0f74-469b-a2be-b56a0721afb2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.748101] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d41be0ec-0f74-469b-a2be-b56a0721afb2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.748931] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d41be0ec-0f74-469b-a2be-b56a0721afb2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.749066] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d41be0ec-0f74-469b-a2be-b56a0721afb2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.169315] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0d6e05da-2389-460c-a38a-c95fe0a87162: rpc.has_security_group_logging(os_id): False [ 713.202631] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.202783] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.202783] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.202984] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.203104] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.203391] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.203501] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.203558] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.203719] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.203798] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.203972] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.204081] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.204135] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.204280] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.204354] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.204540] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.204635] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.204689] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.204878] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.204955] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.205012] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0d6e05da-2389-460c-a38a-c95fe0a87162 is going to be created. [ 713.253094] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d41be0ec-0f74-469b-a2be-b56a0721afb2 [ 713.254036] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.254036] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.254036] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.254267] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.254267] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.254267] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d41be0ec-0f74-469b-a2be-b56a0721afb2 already deleted. [ 713.254437] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d41be0ec-0f74-469b-a2be-b56a0721afb2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.285567] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.286051] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.286320] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.286669] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.287058] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.314871] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0d6e05da-2389-460c-a38a-c95fe0a87162 in Status: IN_PROGRESS for 2s [ 713.658406] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f21a3b6e-da5e-4c92-8717-c114952a5767 in Status: SUCCESS [ 713.658406] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f21a3b6e-da5e-4c92-8717-c114952a5767" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.856549] env[70614]: INFO networking_nsxv3.common.synchronization [req-68587bab-1588-4c46-800a-4242b7727ebd req-668be004-b7b4-406c-8574-0cfc68aa6390 tempest-AttachInterfacesTestJSON-1919943007 tempest-AttachInterfacesTestJSON-1919943007-project-member] Enqueued Resource ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 with Priority: HIGHEST for action security_group_members [ 713.860421] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 with Priority: HIGHEST for action security_group_members [ 713.860835] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d3a5ad0-c473-4d61-9101-9c7582c27390 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.861065] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.861179] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.861711] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.861950] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.862118] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.862870] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.862870] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.862870] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.862870] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d3a5ad0-c473-4d61-9101-9c7582c27390',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.365398] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.365398] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.365398] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.366595] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.366595] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.366595] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.366595] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.366595] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.366595] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.366595] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.366595] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 already deleted. [ 714.366595] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.485978] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-385 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.486267] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-385" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.486347] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-385" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.486640] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-385" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.487710] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.487710] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.487710] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.487710] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.488555] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.488555] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 714.488555] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 714.488555] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 714.488555] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 714.491970] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 714.491970] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 714.491970] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 714.509874] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 714.510110] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 714.510387] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 714.510651] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-385" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.511169] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-1360813a-ac29-4669-9b87-37d28506c4f4 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.511386] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-1360813a-ac29-4669-9b87-37d28506c4f4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.512159] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-1360813a-ac29-4669-9b87-37d28506c4f4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.512159] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-1360813a-ac29-4669-9b87-37d28506c4f4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.513224] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1360813a-ac29-4669-9b87-37d28506c4f4',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.689035] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0060547-03fb-4d1a-ad8e-69519760b908 in Status: SUCCESS [ 714.689150] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0060547-03fb-4d1a-ad8e-69519760b908" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.689344] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0060547-03fb-4d1a-ad8e-69519760b908" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.689574] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0060547-03fb-4d1a-ad8e-69519760b908" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.690280] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.690280] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.690490] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.690542] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.691090] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.691372] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0060547-03fb-4d1a-ad8e-69519760b908" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.691372] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f0060547-03fb-4d1a-ad8e-69519760b908',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.769458] env[70614]: INFO networking_nsxv3.common.synchronization [req-9000a83c-b2b8-4c81-a7c4-430c3b56fcce req-f05f71e4-bb3b-494a-8df3-90f202ace5d0 tempest-SecurityGroupsTestJSON-818479832 tempest-SecurityGroupsTestJSON-818479832-project-member] Enqueued Resource ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 with Priority: HIGHEST for action security_group_members [ 714.770441] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 with Priority: HIGHEST for action security_group_members [ 714.770993] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.771563] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.771563] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.771712] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.771914] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.772151] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.772247] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.772531] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.772709] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.772900] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1440acfc-c5d6-4a44-b0a8-654c4f16a7d1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.016038] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.016251] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.016449] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.016779] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.017648] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.017648] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 1360813a-ac29-4669-9b87-37d28506c4f4 not found, creating... [ 715.017648] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.017842] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.017842] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.018107] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.018239] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.019207] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.019457] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.019611] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.019875] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.022131] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.022131] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 1360813a-ac29-4669-9b87-37d28506c4f4 is going to be created. [ 715.045949] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.054390] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.054390] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.054390] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.054390] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.054390] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-1360813a-ac29-4669-9b87-37d28506c4f4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.198323] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0060547-03fb-4d1a-ad8e-69519760b908 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.198323] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0060547-03fb-4d1a-ad8e-69519760b908" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.198323] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0060547-03fb-4d1a-ad8e-69519760b908" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.198323] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0060547-03fb-4d1a-ad8e-69519760b908" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.198872] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.198872] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.198872] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.199132] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.199255] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.199426] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0060547-03fb-4d1a-ad8e-69519760b908" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.199616] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0060547-03fb-4d1a-ad8e-69519760b908 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.199791] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0060547-03fb-4d1a-ad8e-69519760b908" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.199862] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0060547-03fb-4d1a-ad8e-69519760b908" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.200020] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0060547-03fb-4d1a-ad8e-69519760b908" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.200287] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.200287] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.200531] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.200715] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.200916] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.201232] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0060547-03fb-4d1a-ad8e-69519760b908" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.201373] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f0060547-03fb-4d1a-ad8e-69519760b908',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.279114] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.279371] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.279371] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.279578] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.279696] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.279986] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.280455] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.280455] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.280808] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.280808] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.280808] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 already deleted. [ 715.280999] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.308349] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-28 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.308705] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-28" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.308705] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-28" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.309023] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-28" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.309947] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.310157] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.310453] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.310584] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.310764] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.311159] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 715.312065] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 715.312065] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 715.312065] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 715.312065] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 715.312065] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 715.312065] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 715.337823] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0d6e05da-2389-460c-a38a-c95fe0a87162 in Status: SUCCESS [ 715.338132] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0d6e05da-2389-460c-a38a-c95fe0a87162" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.345159] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 715.345551] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 715.345714] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 715.346272] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-28" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.346272] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-1258b992-2f88-46ad-b103-b3ee191f78db taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.346804] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-1258b992-2f88-46ad-b103-b3ee191f78db" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.346804] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-1258b992-2f88-46ad-b103-b3ee191f78db" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.346804] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-1258b992-2f88-46ad-b103-b3ee191f78db" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.347111] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1258b992-2f88-46ad-b103-b3ee191f78db',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.490482] env[70614]: INFO networking_nsxv3.common.synchronization [None req-41be1693-94ce-4c64-b65a-e5198ca674f4 None None] Enqueued Resource ID: 0016fabd-a67c-4099-baee-d77c5154f013 with Priority: HIGHEST for action port [ 715.491110] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0016fabd-a67c-4099-baee-d77c5154f013 with Priority: HIGHEST for action port [ 715.491436] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-0016fabd-a67c-4099-baee-d77c5154f013 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.491567] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0016fabd-a67c-4099-baee-d77c5154f013" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.491636] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0016fabd-a67c-4099-baee-d77c5154f013" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.492088] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0016fabd-a67c-4099-baee-d77c5154f013" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.492088] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0016fabd-a67c-4099-baee-d77c5154f013',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.643276] env[70614]: INFO networking_nsxv3.common.synchronization [None req-5b7a8fa0-62ef-4fa3-85e8-92be26ad841e None None] Enqueued Resource ID: 124811f9-0b68-416f-9db3-77c73a6d324c with Priority: HIGHEST for action port [ 715.644900] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 124811f9-0b68-416f-9db3-77c73a6d324c with Priority: HIGHEST for action port [ 715.644900] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-124811f9-0b68-416f-9db3-77c73a6d324c taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.644900] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-124811f9-0b68-416f-9db3-77c73a6d324c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.644900] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-124811f9-0b68-416f-9db3-77c73a6d324c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.644900] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-124811f9-0b68-416f-9db3-77c73a6d324c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.644900] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('124811f9-0b68-416f-9db3-77c73a6d324c',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.704594] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f0060547-03fb-4d1a-ad8e-69519760b908: rpc.has_security_group_logging(os_id): False [ 715.729036] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.729036] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.729036] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.729036] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.729036] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.729036] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.729036] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.729036] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.729036] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.729036] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.729036] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.729036] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.729036] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.729036] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.729036] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.729851] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.729851] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.729851] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.729851] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.729851] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.729851] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f0060547-03fb-4d1a-ad8e-69519760b908 is going to be updated. [ 715.850007] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.850416] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.850595] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.853525] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.853525] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.853525] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 1258b992-2f88-46ad-b103-b3ee191f78db not found, creating... [ 715.853525] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.857026] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.857026] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.857026] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.857026] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.857026] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.857026] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.857026] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.857026] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.857026] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.857026] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 1258b992-2f88-46ad-b103-b3ee191f78db is going to be created. [ 715.879284] env[70614]: INFO networking_nsxv3.common.synchronization [req-68587bab-1588-4c46-800a-4242b7727ebd req-1adba4d5-8649-46bc-ab49-1094ec783c4d service nova] Enqueued Resource ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 with Priority: HIGHEST for action security_group_rules [ 715.879284] env[70614]: INFO networking_nsxv3.common.synchronization [req-68587bab-1588-4c46-800a-4242b7727ebd req-1adba4d5-8649-46bc-ab49-1094ec783c4d service nova] Enqueued Resource ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 with Priority: HIGHEST for action security_group_members [ 715.879284] env[70614]: INFO networking_nsxv3.common.synchronization [req-68587bab-1588-4c46-800a-4242b7727ebd req-1adba4d5-8649-46bc-ab49-1094ec783c4d service nova] Enqueued Resource ID: 1360813a-ac29-4669-9b87-37d28506c4f4 with Priority: HIGHEST for action port [ 715.879284] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 with Priority: HIGHEST for action security_group_rules [ 715.879817] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 with Priority: HIGHEST for action security_group_members [ 715.880760] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1360813a-ac29-4669-9b87-37d28506c4f4 with Priority: HIGHEST for action port [ 715.881084] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d3a5ad0-c473-4d61-9101-9c7582c27390 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.882248] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.883141] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.883141] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.883141] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d3a5ad0-c473-4d61-9101-9c7582c27390',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.883999] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d3a5ad0-c473-4d61-9101-9c7582c27390 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.884145] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.884234] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.884375] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.884526] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.884626] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.884695] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.884858] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.884953] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.885032] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d3a5ad0-c473-4d61-9101-9c7582c27390',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.885956] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-1360813a-ac29-4669-9b87-37d28506c4f4 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.886105] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1360813a-ac29-4669-9b87-37d28506c4f4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.886178] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1360813a-ac29-4669-9b87-37d28506c4f4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.887129] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1360813a-ac29-4669-9b87-37d28506c4f4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.887252] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1360813a-ac29-4669-9b87-37d28506c4f4',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.892767] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.893075] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.893121] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.893387] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.893961] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.893961] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-1258b992-2f88-46ad-b103-b3ee191f78db" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.898485] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.898712] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.898712] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.898949] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.899107] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.916075] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f0060547-03fb-4d1a-ad8e-69519760b908 in Status: IN_PROGRESS for 2s [ 715.998068] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0016fabd-a67c-4099-baee-d77c5154f013 [ 715.998315] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.999607] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.999694] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.000009] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.000167] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.000292] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0016fabd-a67c-4099-baee-d77c5154f013 already deleted. [ 716.000389] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0016fabd-a67c-4099-baee-d77c5154f013" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.355887] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 124811f9-0b68-416f-9db3-77c73a6d324c [ 716.355887] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.355887] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.355887] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.355887] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.355887] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.355887] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:124811f9-0b68-416f-9db3-77c73a6d324c already deleted. [ 716.355887] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-124811f9-0b68-416f-9db3-77c73a6d324c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.398163] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d3a5ad0-c473-4d61-9101-9c7582c27390',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.398163] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d3a5ad0-c473-4d61-9101-9c7582c27390 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.398163] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.398480] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1360813a-ac29-4669-9b87-37d28506c4f4 with status ACTIVE [ 716.398480] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.398665] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.399538] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.400017] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.400150] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.400367] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.400528] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.400610] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.400855] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.400970] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.401561] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.401561] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.401561] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.401825] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.401963] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.402114] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1360813a-ac29-4669-9b87-37d28506c4f4 is going to be updated. [ 716.438025] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.438025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.438025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.438025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.438025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.438025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1360813a-ac29-4669-9b87-37d28506c4f4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.788452] env[70614]: INFO networking_nsxv3.common.synchronization [req-9000a83c-b2b8-4c81-a7c4-430c3b56fcce req-110e92cc-fb32-4cc4-bf13-60a3dd2058e3 service nova] Enqueued Resource ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 with Priority: HIGHEST for action security_group_rules [ 716.788452] env[70614]: INFO networking_nsxv3.common.synchronization [req-9000a83c-b2b8-4c81-a7c4-430c3b56fcce req-110e92cc-fb32-4cc4-bf13-60a3dd2058e3 service nova] Enqueued Resource ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 with Priority: HIGHEST for action security_group_members [ 716.788452] env[70614]: INFO networking_nsxv3.common.synchronization [req-9000a83c-b2b8-4c81-a7c4-430c3b56fcce req-110e92cc-fb32-4cc4-bf13-60a3dd2058e3 service nova] Enqueued Resource ID: 1258b992-2f88-46ad-b103-b3ee191f78db with Priority: HIGHEST for action port [ 716.788452] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 with Priority: HIGHEST for action security_group_rules [ 716.788452] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 with Priority: HIGHEST for action security_group_members [ 716.788452] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1258b992-2f88-46ad-b103-b3ee191f78db with Priority: HIGHEST for action port [ 716.788452] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.788452] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.788452] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.790054] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.790054] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1440acfc-c5d6-4a44-b0a8-654c4f16a7d1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.790054] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.790054] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.790054] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.790424] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.790424] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.790424] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.790605] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.790654] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.790713] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.790786] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1440acfc-c5d6-4a44-b0a8-654c4f16a7d1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.791684] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-1258b992-2f88-46ad-b103-b3ee191f78db taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.791829] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1258b992-2f88-46ad-b103-b3ee191f78db" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.791936] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1258b992-2f88-46ad-b103-b3ee191f78db" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.792136] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1258b992-2f88-46ad-b103-b3ee191f78db" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.792211] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1258b992-2f88-46ad-b103-b3ee191f78db',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.906353] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d3a5ad0-c473-4d61-9101-9c7582c27390',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.293732] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.294082] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.294082] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1440acfc-c5d6-4a44-b0a8-654c4f16a7d1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.296106] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1258b992-2f88-46ad-b103-b3ee191f78db with status ACTIVE [ 717.296106] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.296106] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.296106] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.296377] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.296377] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.296583] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.296646] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.296717] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.301029] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.301029] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.301029] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.301029] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.301029] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.301029] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.301029] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.301029] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1258b992-2f88-46ad-b103-b3ee191f78db is going to be updated. [ 717.322267] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.322500] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.322578] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.322793] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.322932] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.323111] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1258b992-2f88-46ad-b103-b3ee191f78db" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.410535] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.410535] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.410535] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.410535] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.410535] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.410991] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 is going to be created. [ 717.453960] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.454234] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.454313] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.454733] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.456213] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.468961] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 in Status: UNINITIALIZED for 2s [ 717.666772] env[70614]: INFO networking_nsxv3.common.synchronization [req-1fdf5f8e-bc1d-4eac-866b-fc14db979ac7 req-be5731e0-9900-4810-8a0e-782ae6359aad tempest-ListServersNegativeTestJSON-1075096126 tempest-ListServersNegativeTestJSON-1075096126-project-member] Enqueued Resource ID: 406660af-f92d-476c-ab5f-e3168c58847d with Priority: HIGHEST for action security_group_members [ 717.667502] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 406660af-f92d-476c-ab5f-e3168c58847d with Priority: HIGHEST for action security_group_members [ 717.667857] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-406660af-f92d-476c-ab5f-e3168c58847d taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.668021] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.668103] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.668449] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.669802] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.669802] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.669802] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.669802] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.669802] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.669802] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('406660af-f92d-476c-ab5f-e3168c58847d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.802603] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1440acfc-c5d6-4a44-b0a8-654c4f16a7d1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.941593] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f0060547-03fb-4d1a-ad8e-69519760b908 in Status: SUCCESS [ 717.941593] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f0060547-03fb-4d1a-ad8e-69519760b908" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.975721] env[70614]: INFO networking_nsxv3.common.synchronization [None req-166f7626-44d8-45b7-b26c-9b76947520de tempest-ServerActionsTestOtherB-1079543702 tempest-ServerActionsTestOtherB-1079543702-project-member] Enqueued Resource ID: 4e54f39e-349d-49ad-bb07-348488d846f0 with Priority: HIGHEST for action security_group_rules [ 717.976402] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e54f39e-349d-49ad-bb07-348488d846f0 with Priority: HIGHEST for action security_group_rules [ 717.976785] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e54f39e-349d-49ad-bb07-348488d846f0 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.977103] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.977393] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.977739] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.977834] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e54f39e-349d-49ad-bb07-348488d846f0',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.136066] env[70614]: INFO networking_nsxv3.common.synchronization [None req-371aea55-1042-4473-88d7-7cd22bd38fd3 tempest-ServerActionsTestOtherB-1079543702 tempest-ServerActionsTestOtherB-1079543702-project-member] Enqueued Resource ID: 4e54f39e-349d-49ad-bb07-348488d846f0 with Priority: HIGHEST for action security_group_rules [ 718.136066] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e54f39e-349d-49ad-bb07-348488d846f0 with Priority: HIGHEST for action security_group_rules [ 718.136066] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e54f39e-349d-49ad-bb07-348488d846f0 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.136066] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.173042] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.173042] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.173042] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.173042] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.173042] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.173042] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.173042] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.173042] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.173042] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.173042] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.173042] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 406660af-f92d-476c-ab5f-e3168c58847d already deleted. [ 718.173042] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.309450] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.309450] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.309450] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.309450] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.309450] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.309450] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 is going to be created. [ 718.337099] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.337290] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.337365] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.337599] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.337769] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.351278] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 in Status: UNINITIALIZED for 2s [ 718.380811] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-668 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.381087] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-668" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.381232] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-668" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.381575] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-668" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.381838] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.382008] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.382133] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.382369] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.382571] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.382844] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 718.382954] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 718.383081] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 718.383200] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 718.383321] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 718.383447] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 718.383592] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 718.406321] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 718.406520] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 718.406677] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 718.406847] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-668" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.407414] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-f1200153-04cb-48d7-a412-916293e0b2ae taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.407619] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-f1200153-04cb-48d7-a412-916293e0b2ae" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.407883] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-f1200153-04cb-48d7-a412-916293e0b2ae" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.408498] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-f1200153-04cb-48d7-a412-916293e0b2ae" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.410065] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1200153-04cb-48d7-a412-916293e0b2ae',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.438129] env[70614]: INFO networking_nsxv3.common.synchronization [None req-2b4e4ddf-5260-439c-8dc5-95fcc8e2627a None None] Enqueued Resource ID: f329d835-9a58-4a0b-b340-b4337cd8960d with Priority: HIGHEST for action port [ 718.439246] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f329d835-9a58-4a0b-b340-b4337cd8960d with Priority: HIGHEST for action port [ 718.439848] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-f329d835-9a58-4a0b-b340-b4337cd8960d taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.439981] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f329d835-9a58-4a0b-b340-b4337cd8960d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.440147] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f329d835-9a58-4a0b-b340-b4337cd8960d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.440401] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f329d835-9a58-4a0b-b340-b4337cd8960d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.440485] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f329d835-9a58-4a0b-b340-b4337cd8960d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.499579] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.499793] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.499942] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.500303] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.500473] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.500609] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e54f39e-349d-49ad-bb07-348488d846f0 already deleted. [ 718.500764] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.501554] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.501828] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.501987] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e54f39e-349d-49ad-bb07-348488d846f0',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.915031] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.915031] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.915031] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.915031] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.915031] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.915031] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port f1200153-04cb-48d7-a412-916293e0b2ae not found, creating... [ 718.915031] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.915031] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.915031] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.915031] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.915031] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.915956] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.919162] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.919545] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.920259] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.920621] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.920966] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: f1200153-04cb-48d7-a412-916293e0b2ae is going to be created. [ 718.944056] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f329d835-9a58-4a0b-b340-b4337cd8960d [ 718.944056] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.944056] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.944056] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.944412] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.944412] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.944949] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f329d835-9a58-4a0b-b340-b4337cd8960d already deleted. [ 718.944949] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f329d835-9a58-4a0b-b340-b4337cd8960d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.950053] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.950298] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.950298] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.950583] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.950850] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.951095] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-f1200153-04cb-48d7-a412-916293e0b2ae" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.028364] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.029122] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.029122] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.029453] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.029549] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.029685] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e54f39e-349d-49ad-bb07-348488d846f0 already deleted. [ 719.029773] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.486074] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 in Status: SUCCESS [ 719.486271] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.487179] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.487179] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.487179] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.487179] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.487179] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.487179] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.487614] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.487614] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.487614] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6d3a5ad0-c473-4d61-9101-9c7582c27390',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.751611] env[70614]: INFO networking_nsxv3.common.synchronization [req-1fdf5f8e-bc1d-4eac-866b-fc14db979ac7 req-053689dd-1fa0-4833-af36-81187b014c86 service nova] Enqueued Resource ID: 406660af-f92d-476c-ab5f-e3168c58847d with Priority: HIGHEST for action security_group_rules [ 719.751951] env[70614]: INFO networking_nsxv3.common.synchronization [req-1fdf5f8e-bc1d-4eac-866b-fc14db979ac7 req-053689dd-1fa0-4833-af36-81187b014c86 service nova] Enqueued Resource ID: 406660af-f92d-476c-ab5f-e3168c58847d with Priority: HIGHEST for action security_group_members [ 719.751951] env[70614]: INFO networking_nsxv3.common.synchronization [req-1fdf5f8e-bc1d-4eac-866b-fc14db979ac7 req-053689dd-1fa0-4833-af36-81187b014c86 service nova] Enqueued Resource ID: f1200153-04cb-48d7-a412-916293e0b2ae with Priority: HIGHEST for action port [ 719.757021] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 406660af-f92d-476c-ab5f-e3168c58847d with Priority: HIGHEST for action security_group_rules [ 719.757021] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 406660af-f92d-476c-ab5f-e3168c58847d with Priority: HIGHEST for action security_group_members [ 719.757021] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1200153-04cb-48d7-a412-916293e0b2ae with Priority: HIGHEST for action port [ 719.757021] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-406660af-f92d-476c-ab5f-e3168c58847d taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.757021] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.757021] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.757021] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.757021] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('406660af-f92d-476c-ab5f-e3168c58847d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.757021] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-406660af-f92d-476c-ab5f-e3168c58847d taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.757021] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.757021] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.757021] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.757021] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.757021] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.757021] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.757795] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.757795] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.757795] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('406660af-f92d-476c-ab5f-e3168c58847d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.758704] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-f1200153-04cb-48d7-a412-916293e0b2ae taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.758704] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f1200153-04cb-48d7-a412-916293e0b2ae" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.758704] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f1200153-04cb-48d7-a412-916293e0b2ae" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.758704] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f1200153-04cb-48d7-a412-916293e0b2ae" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.758704] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1200153-04cb-48d7-a412-916293e0b2ae',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.993048] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d3a5ad0-c473-4d61-9101-9c7582c27390 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.993483] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.993483] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.993817] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.993817] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.993817] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.993817] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.994435] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.994435] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.994435] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.994560] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d3a5ad0-c473-4d61-9101-9c7582c27390 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.994680] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.994745] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.994868] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.995098] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.995195] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.995271] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.995392] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.995461] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.995548] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.995632] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6d3a5ad0-c473-4d61-9101-9c7582c27390',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.261524] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-406660af-f92d-476c-ab5f-e3168c58847d taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.261524] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.261758] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('406660af-f92d-476c-ab5f-e3168c58847d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.262507] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f1200153-04cb-48d7-a412-916293e0b2ae with status ACTIVE [ 720.262703] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.262829] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.262892] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.263144] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.263246] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.264640] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.264640] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.264640] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.266871] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.266871] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.267156] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.267156] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.267156] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.267381] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.267439] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.268929] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f1200153-04cb-48d7-a412-916293e0b2ae is going to be updated. [ 720.298968] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.298968] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.298968] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.298968] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.298968] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.298968] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f1200153-04cb-48d7-a412-916293e0b2ae" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.362481] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 in Status: SUCCESS [ 720.362724] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.363324] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.363324] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.363505] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.363694] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.363842] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.363938] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.364086] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.364175] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.364544] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1440acfc-c5d6-4a44-b0a8-654c4f16a7d1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.500134] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6d3a5ad0-c473-4d61-9101-9c7582c27390: rpc.has_security_group_logging(os_id): False [ 720.521342] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.521342] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.521342] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.521342] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.521342] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.521342] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.521342] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.521342] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.521887] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.521887] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.521887] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.521887] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.521887] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.521887] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.522105] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.522150] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.522221] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.522277] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.522412] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.522480] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.522559] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 is going to be created. [ 720.584294] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.584525] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.584525] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.584850] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.585080] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.601218] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 in Status: IN_PROGRESS for 2s [ 720.773690] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('406660af-f92d-476c-ab5f-e3168c58847d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.867507] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.867675] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.867746] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.868645] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.868645] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.868645] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.868645] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.868645] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.868645] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.868645] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.869171] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.869171] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.869171] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.869171] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.869454] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.869454] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.869580] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.869643] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.869707] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.869762] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.869864] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1440acfc-c5d6-4a44-b0a8-654c4f16a7d1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.276694] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.277049] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.277147] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.277610] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.277610] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.277756] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 406660af-f92d-476c-ab5f-e3168c58847d is going to be created. [ 721.306340] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.306514] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.306586] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.306811] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.307134] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.329185] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 406660af-f92d-476c-ab5f-e3168c58847d in Status: UNINITIALIZED for 2s [ 721.373766] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1: rpc.has_security_group_logging(os_id): False [ 721.400387] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.400603] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.400603] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.400834] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.400929] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.401172] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.401277] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.401337] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.401533] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.401608] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.401863] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.401972] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.402053] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.402260] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.402371] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.402618] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.402777] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.402876] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.403069] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.403195] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.403340] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 is going to be created. [ 721.506800] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.507163] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.507278] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.507555] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.507847] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.523594] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 in Status: IN_PROGRESS for 2s [ 722.615230] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 in Status: SUCCESS [ 722.615651] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.717764] env[70614]: INFO networking_nsxv3.common.synchronization [req-467102cd-77bb-4e28-b0c0-6d53b9e1d500 req-c18a7484-0561-43e9-a999-a5411d03b501 tempest-ImagesNegativeTestJSON-981052346 tempest-ImagesNegativeTestJSON-981052346-project-member] Enqueued Resource ID: 0d6e05da-2389-460c-a38a-c95fe0a87162 with Priority: HIGHEST for action security_group_members [ 722.718429] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d6e05da-2389-460c-a38a-c95fe0a87162 with Priority: HIGHEST for action security_group_members [ 722.718822] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d6e05da-2389-460c-a38a-c95fe0a87162 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.719027] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d6e05da-2389-460c-a38a-c95fe0a87162" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.719137] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d6e05da-2389-460c-a38a-c95fe0a87162" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.719418] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d6e05da-2389-460c-a38a-c95fe0a87162" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.719653] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.720133] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.720133] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.720336] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.720336] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.720514] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d6e05da-2389-460c-a38a-c95fe0a87162',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.223018] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.223287] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.223287] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.223643] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.223643] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.223789] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.223891] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.223950] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.224120] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.224206] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.224354] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d6e05da-2389-460c-a38a-c95fe0a87162 is going to be updated. [ 723.239712] env[70614]: INFO networking_nsxv3.common.synchronization [req-1fdf5f8e-bc1d-4eac-866b-fc14db979ac7 req-5bcedba3-13e0-42b4-a3c5-fc0df3fac4eb tempest-ListServersNegativeTestJSON-1075096126 tempest-ListServersNegativeTestJSON-1075096126-project-member] Enqueued Resource ID: 406660af-f92d-476c-ab5f-e3168c58847d with Priority: HIGHEST for action security_group_members [ 723.239944] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 406660af-f92d-476c-ab5f-e3168c58847d with Priority: HIGHEST for action security_group_members [ 723.240282] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-406660af-f92d-476c-ab5f-e3168c58847d taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.240391] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.252381] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.252381] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.252516] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.253140] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.253140] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.263079] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d6e05da-2389-460c-a38a-c95fe0a87162 in Status: IN_PROGRESS for 2s [ 723.341832] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 406660af-f92d-476c-ab5f-e3168c58847d in Status: SUCCESS [ 723.341832] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.341832] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.341832] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.342707] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.342707] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.342707] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.342707] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.342707] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.343145] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.343145] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('406660af-f92d-476c-ab5f-e3168c58847d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.344529] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.344677] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.344828] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.345038] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.345110] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.345298] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.345412] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.345509] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('406660af-f92d-476c-ab5f-e3168c58847d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.538052] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 in Status: SUCCESS [ 723.538305] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.592475] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-668 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.592750] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-668" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.592911] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-668" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.593322] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-668" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.593616] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.593797] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.593930] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.594278] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.594370] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.594604] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 723.594730] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 723.594854] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 723.595036] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 723.595200] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 723.595341] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 723.595486] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 723.616432] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 723.616432] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 723.617071] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 723.617071] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-668" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.617071] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-29ac1aa7-0503-4fd3-8897-446c592a8a73 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.617219] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-29ac1aa7-0503-4fd3-8897-446c592a8a73" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.617344] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-29ac1aa7-0503-4fd3-8897-446c592a8a73" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.617680] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-29ac1aa7-0503-4fd3-8897-446c592a8a73" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.617825] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('29ac1aa7-0503-4fd3-8897-446c592a8a73',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.850566] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-406660af-f92d-476c-ab5f-e3168c58847d taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.850763] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.850900] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('406660af-f92d-476c-ab5f-e3168c58847d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.121394] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.121693] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.121863] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.122258] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.122446] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.122608] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 29ac1aa7-0503-4fd3-8897-446c592a8a73 not found, creating... [ 724.122903] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.123122] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.123277] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.123613] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.123768] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.124200] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.124417] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.124604] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.124917] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.125237] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.125459] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 29ac1aa7-0503-4fd3-8897-446c592a8a73 is going to be created. [ 724.148691] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.148915] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.149056] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.149317] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.149575] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.149791] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-29ac1aa7-0503-4fd3-8897-446c592a8a73" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.353390] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('406660af-f92d-476c-ab5f-e3168c58847d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.830316] env[70614]: INFO networking_nsxv3.common.synchronization [req-1fdf5f8e-bc1d-4eac-866b-fc14db979ac7 req-2afbecc9-fee7-4544-a0fb-4d6677c9fa50 service nova] Enqueued Resource ID: 406660af-f92d-476c-ab5f-e3168c58847d with Priority: HIGHEST for action security_group_rules [ 724.830316] env[70614]: INFO networking_nsxv3.common.synchronization [req-1fdf5f8e-bc1d-4eac-866b-fc14db979ac7 req-2afbecc9-fee7-4544-a0fb-4d6677c9fa50 service nova] Enqueued Resource ID: 406660af-f92d-476c-ab5f-e3168c58847d with Priority: HIGHEST for action security_group_members [ 724.830316] env[70614]: INFO networking_nsxv3.common.synchronization [req-1fdf5f8e-bc1d-4eac-866b-fc14db979ac7 req-2afbecc9-fee7-4544-a0fb-4d6677c9fa50 service nova] Enqueued Resource ID: 29ac1aa7-0503-4fd3-8897-446c592a8a73 with Priority: HIGHEST for action port [ 724.830316] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 406660af-f92d-476c-ab5f-e3168c58847d with Priority: HIGHEST for action security_group_rules [ 724.830316] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 406660af-f92d-476c-ab5f-e3168c58847d with Priority: HIGHEST for action security_group_members [ 724.830316] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29ac1aa7-0503-4fd3-8897-446c592a8a73 with Priority: HIGHEST for action port [ 724.830316] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-406660af-f92d-476c-ab5f-e3168c58847d taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.830316] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.831395] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-406660af-f92d-476c-ab5f-e3168c58847d taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.831507] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.831707] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-29ac1aa7-0503-4fd3-8897-446c592a8a73 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.831867] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-29ac1aa7-0503-4fd3-8897-446c592a8a73" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.831867] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-29ac1aa7-0503-4fd3-8897-446c592a8a73" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.832082] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-29ac1aa7-0503-4fd3-8897-446c592a8a73" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.832179] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('29ac1aa7-0503-4fd3-8897-446c592a8a73',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.856443] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.856616] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.856685] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.856941] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.857081] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.857193] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 406660af-f92d-476c-ab5f-e3168c58847d is going to be updated. [ 724.891725] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.891725] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.891725] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.891993] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.891993] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.901670] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 406660af-f92d-476c-ab5f-e3168c58847d in Status: IN_PROGRESS for 2s [ 725.276700] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d6e05da-2389-460c-a38a-c95fe0a87162 in Status: SUCCESS [ 725.276924] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d6e05da-2389-460c-a38a-c95fe0a87162 deletion is rescheduled due to dependency. [ 725.277111] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d6e05da-2389-460c-a38a-c95fe0a87162" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.335451] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 29ac1aa7-0503-4fd3-8897-446c592a8a73 with status ACTIVE [ 725.335612] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.335771] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.335857] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.336064] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.336175] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.336352] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.336455] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.336548] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.336704] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.336810] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.336919] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.337114] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.337181] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.337322] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.337395] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.337734] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 29ac1aa7-0503-4fd3-8897-446c592a8a73 is going to be updated. [ 725.364783] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.365041] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.365041] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.365248] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.365433] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.365619] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-29ac1aa7-0503-4fd3-8897-446c592a8a73" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.927623] env[70614]: INFO networking_nsxv3.common.synchronization [req-1fdf5f8e-bc1d-4eac-866b-fc14db979ac7 req-148f977a-110b-489f-ade4-ae92d02735f4 tempest-ListServersNegativeTestJSON-1075096126 tempest-ListServersNegativeTestJSON-1075096126-project-member] Enqueued Resource ID: 406660af-f92d-476c-ab5f-e3168c58847d with Priority: HIGHEST for action security_group_members [ 725.929176] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 406660af-f92d-476c-ab5f-e3168c58847d with Priority: HIGHEST for action security_group_members [ 725.929176] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-406660af-f92d-476c-ab5f-e3168c58847d taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.929176] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.700034] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-668 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.700034] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-668" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.700034] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-668" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.700338] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-668" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.700639] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.700814] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.700932] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.701191] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.701364] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.701596] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 726.701726] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 726.701836] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 726.701943] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 726.702064] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 726.702560] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 726.702560] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 726.724596] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 726.724943] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 726.725208] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 726.725425] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-668" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.725779] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-c2834ac0-7999-4acc-bc13-2ccc90fb1c56 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.726011] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-c2834ac0-7999-4acc-bc13-2ccc90fb1c56" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.726134] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-c2834ac0-7999-4acc-bc13-2ccc90fb1c56" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.726509] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-c2834ac0-7999-4acc-bc13-2ccc90fb1c56" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.726664] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2834ac0-7999-4acc-bc13-2ccc90fb1c56',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.912087] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 406660af-f92d-476c-ab5f-e3168c58847d in Status: SUCCESS [ 726.912361] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.912554] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.912786] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.913061] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.913220] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.913315] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.913480] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.913563] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.913691] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.913856] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-406660af-f92d-476c-ab5f-e3168c58847d taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.913939] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.913998] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.914175] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.914337] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.914445] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.914508] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.914657] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.914730] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.914819] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.914936] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('406660af-f92d-476c-ab5f-e3168c58847d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.915898] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.916148] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.920015] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.920015] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.920015] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.920015] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.920015] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.920015] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('406660af-f92d-476c-ab5f-e3168c58847d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.232059] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.232059] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.232059] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.232059] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.232059] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.232940] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port c2834ac0-7999-4acc-bc13-2ccc90fb1c56 not found, creating... [ 727.232940] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.232940] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.232940] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.232940] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.233301] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.233424] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.233585] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.233703] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.233914] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.234087] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.234239] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: c2834ac0-7999-4acc-bc13-2ccc90fb1c56 is going to be created. [ 727.256253] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.256630] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.256761] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.257688] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.257688] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.257688] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-c2834ac0-7999-4acc-bc13-2ccc90fb1c56" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.419966] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 406660af-f92d-476c-ab5f-e3168c58847d: rpc.has_security_group_logging(os_id): False [ 727.422539] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('406660af-f92d-476c-ab5f-e3168c58847d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.451358] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.451629] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.451712] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.453737] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.453737] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.453737] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.453737] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.453737] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.453737] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.453737] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.453737] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.454378] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.454378] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.454378] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.454378] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.454587] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.454587] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.454738] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.456444] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.456444] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.456444] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 406660af-f92d-476c-ab5f-e3168c58847d is going to be created. [ 727.535326] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.535563] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.535563] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.535800] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.536055] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.550280] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 406660af-f92d-476c-ab5f-e3168c58847d in Status: IN_PROGRESS for 2s [ 727.859085] env[70614]: INFO networking_nsxv3.common.synchronization [req-4c38016c-5155-4353-b03a-e7225b043e05 req-17108b69-b39e-4fdc-8974-3ad321f7798e tempest-SecurityGroupsTestJSON-818479832 tempest-SecurityGroupsTestJSON-818479832-project-member] Enqueued Resource ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 with Priority: HIGHEST for action security_group_members [ 727.859085] env[70614]: INFO networking_nsxv3.common.synchronization [req-4c38016c-5155-4353-b03a-e7225b043e05 req-17108b69-b39e-4fdc-8974-3ad321f7798e tempest-SecurityGroupsTestJSON-818479832 tempest-SecurityGroupsTestJSON-818479832-project-member] Enqueued Resource ID: 55f254c4-5a5d-440f-958c-5fd96778e473 with Priority: HIGHEST for action security_group_members [ 727.860348] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 with Priority: HIGHEST for action security_group_members [ 727.860496] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55f254c4-5a5d-440f-958c-5fd96778e473 with Priority: HIGHEST for action security_group_members [ 727.860781] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.860975] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.860975] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.861195] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.861348] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.861451] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.861525] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.861660] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.861751] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.861839] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1440acfc-c5d6-4a44-b0a8-654c4f16a7d1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.862718] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-55f254c4-5a5d-440f-958c-5fd96778e473 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.862836] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55f254c4-5a5d-440f-958c-5fd96778e473" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.862897] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55f254c4-5a5d-440f-958c-5fd96778e473" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.863131] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55f254c4-5a5d-440f-958c-5fd96778e473" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.863280] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.863377] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.863441] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.863581] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.863662] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.863750] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55f254c4-5a5d-440f-958c-5fd96778e473',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.911682] env[70614]: INFO networking_nsxv3.common.synchronization [req-4c38016c-5155-4353-b03a-e7225b043e05 req-17108b69-b39e-4fdc-8974-3ad321f7798e tempest-SecurityGroupsTestJSON-818479832 tempest-SecurityGroupsTestJSON-818479832-project-member] Enqueued Resource ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 with Priority: HIGHEST for action security_group_rules [ 727.911980] env[70614]: INFO networking_nsxv3.common.synchronization [req-4c38016c-5155-4353-b03a-e7225b043e05 req-17108b69-b39e-4fdc-8974-3ad321f7798e tempest-SecurityGroupsTestJSON-818479832 tempest-SecurityGroupsTestJSON-818479832-project-member] Enqueued Resource ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 with Priority: HIGHEST for action security_group_members [ 727.912257] env[70614]: INFO networking_nsxv3.common.synchronization [req-4c38016c-5155-4353-b03a-e7225b043e05 req-17108b69-b39e-4fdc-8974-3ad321f7798e tempest-SecurityGroupsTestJSON-818479832 tempest-SecurityGroupsTestJSON-818479832-project-member] Enqueued Resource ID: 55f254c4-5a5d-440f-958c-5fd96778e473 with Priority: HIGHEST for action security_group_rules [ 727.912490] env[70614]: INFO networking_nsxv3.common.synchronization [req-4c38016c-5155-4353-b03a-e7225b043e05 req-17108b69-b39e-4fdc-8974-3ad321f7798e tempest-SecurityGroupsTestJSON-818479832 tempest-SecurityGroupsTestJSON-818479832-project-member] Enqueued Resource ID: 55f254c4-5a5d-440f-958c-5fd96778e473 with Priority: HIGHEST for action security_group_members [ 727.912822] env[70614]: INFO networking_nsxv3.common.synchronization [req-4c38016c-5155-4353-b03a-e7225b043e05 req-17108b69-b39e-4fdc-8974-3ad321f7798e tempest-SecurityGroupsTestJSON-818479832 tempest-SecurityGroupsTestJSON-818479832-project-member] Enqueued Resource ID: 1258b992-2f88-46ad-b103-b3ee191f78db with Priority: HIGHEST for action port [ 727.913639] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 with Priority: HIGHEST for action security_group_rules [ 727.914660] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55f254c4-5a5d-440f-958c-5fd96778e473 with Priority: HIGHEST for action security_group_rules [ 727.914660] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1258b992-2f88-46ad-b103-b3ee191f78db with Priority: HIGHEST for action port [ 727.914660] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 with Priority: HIGHEST for action security_group_members [ 727.914660] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55f254c4-5a5d-440f-958c-5fd96778e473 with Priority: HIGHEST for action security_group_members [ 727.914660] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.914996] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.915248] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.915694] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.915694] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1440acfc-c5d6-4a44-b0a8-654c4f16a7d1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.916872] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55f254c4-5a5d-440f-958c-5fd96778e473 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.917138] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55f254c4-5a5d-440f-958c-5fd96778e473" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.917206] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55f254c4-5a5d-440f-958c-5fd96778e473" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.917532] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55f254c4-5a5d-440f-958c-5fd96778e473" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.917650] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55f254c4-5a5d-440f-958c-5fd96778e473',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.919100] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-1258b992-2f88-46ad-b103-b3ee191f78db taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.919280] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1258b992-2f88-46ad-b103-b3ee191f78db" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.919392] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1258b992-2f88-46ad-b103-b3ee191f78db" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.919965] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1258b992-2f88-46ad-b103-b3ee191f78db" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.920123] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1258b992-2f88-46ad-b103-b3ee191f78db',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.922660] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.922660] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.922660] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-55f254c4-5a5d-440f-958c-5fd96778e473 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.922660] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55f254c4-5a5d-440f-958c-5fd96778e473" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.925966] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('406660af-f92d-476c-ab5f-e3168c58847d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.205170] env[70614]: INFO networking_nsxv3.common.synchronization [req-1fdf5f8e-bc1d-4eac-866b-fc14db979ac7 req-c7ccad7f-3780-455f-8036-fced21d64f20 service nova] Enqueued Resource ID: 406660af-f92d-476c-ab5f-e3168c58847d with Priority: HIGHEST for action security_group_rules [ 728.205337] env[70614]: INFO networking_nsxv3.common.synchronization [req-1fdf5f8e-bc1d-4eac-866b-fc14db979ac7 req-c7ccad7f-3780-455f-8036-fced21d64f20 service nova] Enqueued Resource ID: 406660af-f92d-476c-ab5f-e3168c58847d with Priority: HIGHEST for action security_group_members [ 728.205494] env[70614]: INFO networking_nsxv3.common.synchronization [req-1fdf5f8e-bc1d-4eac-866b-fc14db979ac7 req-c7ccad7f-3780-455f-8036-fced21d64f20 service nova] Enqueued Resource ID: c2834ac0-7999-4acc-bc13-2ccc90fb1c56 with Priority: HIGHEST for action port [ 728.205799] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 406660af-f92d-476c-ab5f-e3168c58847d with Priority: HIGHEST for action security_group_rules [ 728.205799] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 406660af-f92d-476c-ab5f-e3168c58847d with Priority: HIGHEST for action security_group_members [ 728.205973] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2834ac0-7999-4acc-bc13-2ccc90fb1c56 with Priority: HIGHEST for action port [ 728.206512] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-406660af-f92d-476c-ab5f-e3168c58847d taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.206645] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.206809] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-406660af-f92d-476c-ab5f-e3168c58847d taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.206905] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.207141] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-c2834ac0-7999-4acc-bc13-2ccc90fb1c56 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.207300] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c2834ac0-7999-4acc-bc13-2ccc90fb1c56" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.207300] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c2834ac0-7999-4acc-bc13-2ccc90fb1c56" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.207508] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c2834ac0-7999-4acc-bc13-2ccc90fb1c56" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.207581] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2834ac0-7999-4acc-bc13-2ccc90fb1c56',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.366403] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1440acfc-c5d6-4a44-b0a8-654c4f16a7d1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.371472] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('55f254c4-5a5d-440f-958c-5fd96778e473',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.422705] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1258b992-2f88-46ad-b103-b3ee191f78db with status ACTIVE [ 728.426024] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.426024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.426024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.426024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.426024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.426024] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.426024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.426024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.426024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.426024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.426024] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.426024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.426024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.426024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.426024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.426024] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1258b992-2f88-46ad-b103-b3ee191f78db is going to be updated. [ 728.427911] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.429054] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.429054] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-55f254c4-5a5d-440f-958c-5fd96778e473 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.429054] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55f254c4-5a5d-440f-958c-5fd96778e473" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.429586] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.429831] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.430156] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.430486] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.431263] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.431263] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 406660af-f92d-476c-ab5f-e3168c58847d is going to be updated. [ 728.453228] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.453228] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.453228] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.453228] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.453228] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.453228] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1258b992-2f88-46ad-b103-b3ee191f78db" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.461331] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.461331] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.461521] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.461564] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.462019] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.472373] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 406660af-f92d-476c-ab5f-e3168c58847d in Status: IN_PROGRESS for 2s [ 728.711664] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c2834ac0-7999-4acc-bc13-2ccc90fb1c56 with status ACTIVE [ 728.711664] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.711664] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.711664] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.711981] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.711981] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.717312] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.717312] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.717312] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.717312] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.717312] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.717312] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.717312] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.717312] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.717312] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.717312] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.717312] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c2834ac0-7999-4acc-bc13-2ccc90fb1c56 is going to be updated. [ 728.739021] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.739021] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.739021] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.739021] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.739021] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.739021] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c2834ac0-7999-4acc-bc13-2ccc90fb1c56" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.872644] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1440acfc-c5d6-4a44-b0a8-654c4f16a7d1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.877304] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('55f254c4-5a5d-440f-958c-5fd96778e473',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.375615] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.375615] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.375615] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.376116] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.376116] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.376116] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 is going to be updated. [ 729.380071] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.380248] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.380322] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.380533] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.380915] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.380915] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55f254c4-5a5d-440f-958c-5fd96778e473 is going to be created. [ 729.410486] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.410675] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.410752] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.410966] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.411195] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.415863] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.415863] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.416272] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.416272] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.416410] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.426717] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 in Status: IN_PROGRESS for 2s [ 729.428279] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55f254c4-5a5d-440f-958c-5fd96778e473 in Status: UNINITIALIZED for 2s [ 729.563973] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 406660af-f92d-476c-ab5f-e3168c58847d in Status: SUCCESS [ 729.564120] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.564326] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.564600] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.564691] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('406660af-f92d-476c-ab5f-e3168c58847d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.580667] env[70614]: INFO networking_nsxv3.common.synchronization [req-0800705b-8568-4332-873f-0c7305143ca8 req-3984b66e-2e5f-4fed-a8d8-67f4e7b47996 tempest-SecurityGroupsTestJSON-818479832 tempest-SecurityGroupsTestJSON-818479832-project-member] Enqueued Resource ID: 81470f34-f44d-4111-b9a8-fc43c119e1dd with Priority: HIGHEST for action security_group_members [ 729.580667] env[70614]: INFO networking_nsxv3.common.synchronization [req-0800705b-8568-4332-873f-0c7305143ca8 req-3984b66e-2e5f-4fed-a8d8-67f4e7b47996 tempest-SecurityGroupsTestJSON-818479832 tempest-SecurityGroupsTestJSON-818479832-project-member] Enqueued Resource ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 with Priority: HIGHEST for action security_group_members [ 729.580667] env[70614]: INFO networking_nsxv3.common.synchronization [req-0800705b-8568-4332-873f-0c7305143ca8 req-3984b66e-2e5f-4fed-a8d8-67f4e7b47996 tempest-SecurityGroupsTestJSON-818479832 tempest-SecurityGroupsTestJSON-818479832-project-member] Enqueued Resource ID: 55f254c4-5a5d-440f-958c-5fd96778e473 with Priority: HIGHEST for action security_group_members [ 729.582660] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81470f34-f44d-4111-b9a8-fc43c119e1dd with Priority: HIGHEST for action security_group_members [ 729.582660] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 with Priority: HIGHEST for action security_group_members [ 729.582660] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55f254c4-5a5d-440f-958c-5fd96778e473 with Priority: HIGHEST for action security_group_members [ 729.582660] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-81470f34-f44d-4111-b9a8-fc43c119e1dd taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.582660] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81470f34-f44d-4111-b9a8-fc43c119e1dd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.582660] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81470f34-f44d-4111-b9a8-fc43c119e1dd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.582660] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81470f34-f44d-4111-b9a8-fc43c119e1dd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.582660] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.582660] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.582660] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.583496] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.583496] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.583496] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('81470f34-f44d-4111-b9a8-fc43c119e1dd',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.588180] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.588180] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.588180] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-55f254c4-5a5d-440f-958c-5fd96778e473 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.588180] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55f254c4-5a5d-440f-958c-5fd96778e473" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.700239] env[70614]: INFO networking_nsxv3.common.synchronization [req-0800705b-8568-4332-873f-0c7305143ca8 req-3984b66e-2e5f-4fed-a8d8-67f4e7b47996 tempest-SecurityGroupsTestJSON-818479832 tempest-SecurityGroupsTestJSON-818479832-project-member] Enqueued Resource ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 with Priority: HIGHEST for action security_group_rules [ 729.700630] env[70614]: INFO networking_nsxv3.common.synchronization [req-0800705b-8568-4332-873f-0c7305143ca8 req-3984b66e-2e5f-4fed-a8d8-67f4e7b47996 tempest-SecurityGroupsTestJSON-818479832 tempest-SecurityGroupsTestJSON-818479832-project-member] Enqueued Resource ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 with Priority: HIGHEST for action security_group_members [ 729.700630] env[70614]: INFO networking_nsxv3.common.synchronization [req-0800705b-8568-4332-873f-0c7305143ca8 req-3984b66e-2e5f-4fed-a8d8-67f4e7b47996 tempest-SecurityGroupsTestJSON-818479832 tempest-SecurityGroupsTestJSON-818479832-project-member] Enqueued Resource ID: 55f254c4-5a5d-440f-958c-5fd96778e473 with Priority: HIGHEST for action security_group_rules [ 729.700793] env[70614]: INFO networking_nsxv3.common.synchronization [req-0800705b-8568-4332-873f-0c7305143ca8 req-3984b66e-2e5f-4fed-a8d8-67f4e7b47996 tempest-SecurityGroupsTestJSON-818479832 tempest-SecurityGroupsTestJSON-818479832-project-member] Enqueued Resource ID: 55f254c4-5a5d-440f-958c-5fd96778e473 with Priority: HIGHEST for action security_group_members [ 729.700793] env[70614]: INFO networking_nsxv3.common.synchronization [req-0800705b-8568-4332-873f-0c7305143ca8 req-3984b66e-2e5f-4fed-a8d8-67f4e7b47996 tempest-SecurityGroupsTestJSON-818479832 tempest-SecurityGroupsTestJSON-818479832-project-member] Enqueued Resource ID: 81470f34-f44d-4111-b9a8-fc43c119e1dd with Priority: HIGHEST for action security_group_rules [ 729.700891] env[70614]: INFO networking_nsxv3.common.synchronization [req-0800705b-8568-4332-873f-0c7305143ca8 req-3984b66e-2e5f-4fed-a8d8-67f4e7b47996 tempest-SecurityGroupsTestJSON-818479832 tempest-SecurityGroupsTestJSON-818479832-project-member] Enqueued Resource ID: 81470f34-f44d-4111-b9a8-fc43c119e1dd with Priority: HIGHEST for action security_group_members [ 729.701023] env[70614]: INFO networking_nsxv3.common.synchronization [req-0800705b-8568-4332-873f-0c7305143ca8 req-3984b66e-2e5f-4fed-a8d8-67f4e7b47996 tempest-SecurityGroupsTestJSON-818479832 tempest-SecurityGroupsTestJSON-818479832-project-member] Enqueued Resource ID: 1258b992-2f88-46ad-b103-b3ee191f78db with Priority: HIGHEST for action port [ 729.701590] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 with Priority: HIGHEST for action security_group_rules [ 729.703075] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55f254c4-5a5d-440f-958c-5fd96778e473 with Priority: HIGHEST for action security_group_rules [ 729.703075] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81470f34-f44d-4111-b9a8-fc43c119e1dd with Priority: HIGHEST for action security_group_members [ 729.703075] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1258b992-2f88-46ad-b103-b3ee191f78db with Priority: HIGHEST for action port [ 729.703075] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81470f34-f44d-4111-b9a8-fc43c119e1dd with Priority: HIGHEST for action security_group_rules [ 729.703075] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 with Priority: HIGHEST for action security_group_members [ 729.703075] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55f254c4-5a5d-440f-958c-5fd96778e473 with Priority: HIGHEST for action security_group_members [ 729.703075] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.703075] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.703075] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55f254c4-5a5d-440f-958c-5fd96778e473 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.703075] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55f254c4-5a5d-440f-958c-5fd96778e473" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.703075] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-81470f34-f44d-4111-b9a8-fc43c119e1dd taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.703852] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81470f34-f44d-4111-b9a8-fc43c119e1dd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.703852] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-1258b992-2f88-46ad-b103-b3ee191f78db taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.703852] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1258b992-2f88-46ad-b103-b3ee191f78db" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.703852] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1258b992-2f88-46ad-b103-b3ee191f78db" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.703852] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1258b992-2f88-46ad-b103-b3ee191f78db" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.703852] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1258b992-2f88-46ad-b103-b3ee191f78db',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.704709] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-81470f34-f44d-4111-b9a8-fc43c119e1dd taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.704816] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-81470f34-f44d-4111-b9a8-fc43c119e1dd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.704889] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-81470f34-f44d-4111-b9a8-fc43c119e1dd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.709993] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-81470f34-f44d-4111-b9a8-fc43c119e1dd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.710167] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('81470f34-f44d-4111-b9a8-fc43c119e1dd',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.711565] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.711648] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.711943] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-55f254c4-5a5d-440f-958c-5fd96778e473 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.711943] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55f254c4-5a5d-440f-958c-5fd96778e473" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.075358] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-406660af-f92d-476c-ab5f-e3168c58847d taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.075503] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.089453] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('81470f34-f44d-4111-b9a8-fc43c119e1dd',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.213969] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-81470f34-f44d-4111-b9a8-fc43c119e1dd taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.214285] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81470f34-f44d-4111-b9a8-fc43c119e1dd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.214583] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1258b992-2f88-46ad-b103-b3ee191f78db with status ACTIVE [ 730.215704] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.215704] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.215704] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.215704] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.216171] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.216171] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.216324] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.216453] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.216694] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.218156] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.218451] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.218838] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.218838] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.219125] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.219370] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.219419] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1258b992-2f88-46ad-b103-b3ee191f78db is going to be updated. [ 730.265602] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.265778] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.265930] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.266120] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.266354] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.266575] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1258b992-2f88-46ad-b103-b3ee191f78db" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.486139] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 406660af-f92d-476c-ab5f-e3168c58847d in Status: SUCCESS [ 730.486476] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.487513] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.487513] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.487513] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.487513] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.487513] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.488195] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.488195] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.488195] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('406660af-f92d-476c-ab5f-e3168c58847d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.594348] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('81470f34-f44d-4111-b9a8-fc43c119e1dd',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.991654] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('406660af-f92d-476c-ab5f-e3168c58847d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.096607] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.096778] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.096842] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.097141] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.099469] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.099469] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81470f34-f44d-4111-b9a8-fc43c119e1dd is going to be created. [ 731.129642] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.129832] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.129885] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.130085] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.130254] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.142252] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81470f34-f44d-4111-b9a8-fc43c119e1dd in Status: UNINITIALIZED for 2s [ 731.448031] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 in Status: SUCCESS [ 731.448031] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.448031] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.448031] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.448031] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.448031] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.448031] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.448031] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.448031] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.448031] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1440acfc-c5d6-4a44-b0a8-654c4f16a7d1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.450439] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55f254c4-5a5d-440f-958c-5fd96778e473 in Status: SUCCESS [ 731.451176] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55f254c4-5a5d-440f-958c-5fd96778e473" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.451557] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55f254c4-5a5d-440f-958c-5fd96778e473" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.451896] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55f254c4-5a5d-440f-958c-5fd96778e473" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.452416] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.452717] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.452965] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.453642] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.453844] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.454045] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55f254c4-5a5d-440f-958c-5fd96778e473',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.493203] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('406660af-f92d-476c-ab5f-e3168c58847d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.605444] env[70614]: INFO networking_nsxv3.common.synchronization [req-89d913dd-a89a-4d5c-8b87-45eef6e73919 req-122fab49-4988-4276-8ef0-f98ce89d9a9f tempest-ImagesOneServerNegativeTestJSON-1769697081 tempest-ImagesOneServerNegativeTestJSON-1769697081-project-member] Enqueued Resource ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e with Priority: HIGHEST for action security_group_members [ 731.605444] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e with Priority: HIGHEST for action security_group_members [ 731.605444] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-3060abf5-a0d6-4fce-88da-15f03f632b6e taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.605444] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.605444] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.605444] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.605444] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.605444] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.605444] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.605444] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.606120] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.606360] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3060abf5-a0d6-4fce-88da-15f03f632b6e',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.958043] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1440acfc-c5d6-4a44-b0a8-654c4f16a7d1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.958043] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('55f254c4-5a5d-440f-958c-5fd96778e473',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.995271] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.995480] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.995534] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.995706] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.995794] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.995982] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 406660af-f92d-476c-ab5f-e3168c58847d is going to be updated. [ 732.029230] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.029496] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.029556] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.029780] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.029934] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.045199] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 406660af-f92d-476c-ab5f-e3168c58847d in Status: IN_PROGRESS for 2s [ 732.109952] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.110589] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.110726] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.111097] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.111294] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.111675] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.111855] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.111997] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.112260] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.112365] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.112827] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e already deleted. [ 732.112827] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.244258] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-720 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.244448] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-720" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.244568] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-720" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.244948] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-720" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.245291] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.245457] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.245575] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.245810] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.246018] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.249020] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 732.249020] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 732.249020] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 732.249020] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 732.249020] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 732.249020] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 732.249020] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 732.279559] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 732.279559] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 732.279559] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 732.279559] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-720" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.281279] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-fb5f09a7-2f43-4511-b843-689086b0554a taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.281279] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-fb5f09a7-2f43-4511-b843-689086b0554a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.281279] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-fb5f09a7-2f43-4511-b843-689086b0554a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.281279] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-fb5f09a7-2f43-4511-b843-689086b0554a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.281279] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb5f09a7-2f43-4511-b843-689086b0554a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.459793] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1440acfc-c5d6-4a44-b0a8-654c4f16a7d1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.461226] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('55f254c4-5a5d-440f-958c-5fd96778e473',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.784676] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.785103] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.786651] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.786651] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.786651] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.786651] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port fb5f09a7-2f43-4511-b843-689086b0554a not found, creating... [ 732.786651] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.786651] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.787055] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.787302] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.787302] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.787800] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.787800] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.788017] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.789018] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.789018] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.789018] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: fb5f09a7-2f43-4511-b843-689086b0554a is going to be created. [ 732.814104] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.814104] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.814104] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.814985] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.814985] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.814985] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-fb5f09a7-2f43-4511-b843-689086b0554a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.966253] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.966478] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.966529] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.966886] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.967087] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.967161] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 is going to be updated. [ 732.973276] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.973507] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.973565] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.973790] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.973916] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.974081] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55f254c4-5a5d-440f-958c-5fd96778e473 is going to be updated. [ 733.020204] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.020204] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.020204] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.020204] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.020204] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.022352] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.022549] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.022549] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.022737] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.022876] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.037059] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 in Status: IN_PROGRESS for 2s [ 733.037580] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55f254c4-5a5d-440f-958c-5fd96778e473 in Status: IN_PROGRESS for 2s [ 733.154404] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81470f34-f44d-4111-b9a8-fc43c119e1dd in Status: SUCCESS [ 733.154404] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81470f34-f44d-4111-b9a8-fc43c119e1dd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.154404] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81470f34-f44d-4111-b9a8-fc43c119e1dd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.154857] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81470f34-f44d-4111-b9a8-fc43c119e1dd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.154857] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.154993] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.155142] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.155191] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.155273] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.155392] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('81470f34-f44d-4111-b9a8-fc43c119e1dd',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.369016] env[70614]: INFO networking_nsxv3.common.synchronization [None req-0da6b2dc-a47f-40e3-b4bb-2f5cd7753e78 None None] Enqueued Resource ID: 64840bbc-3ea2-4e5f-a222-2e226497774e with Priority: HIGHEST for action port [ 733.369681] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64840bbc-3ea2-4e5f-a222-2e226497774e with Priority: HIGHEST for action port [ 733.369969] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-64840bbc-3ea2-4e5f-a222-2e226497774e taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.370954] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-64840bbc-3ea2-4e5f-a222-2e226497774e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.370954] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-64840bbc-3ea2-4e5f-a222-2e226497774e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.371084] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-64840bbc-3ea2-4e5f-a222-2e226497774e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.371196] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64840bbc-3ea2-4e5f-a222-2e226497774e',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.657884] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('81470f34-f44d-4111-b9a8-fc43c119e1dd',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.873689] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 64840bbc-3ea2-4e5f-a222-2e226497774e [ 733.873964] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.874257] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.874257] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.874459] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.874459] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.874531] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:64840bbc-3ea2-4e5f-a222-2e226497774e already deleted. [ 733.875669] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-64840bbc-3ea2-4e5f-a222-2e226497774e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.055477] env[70614]: INFO networking_nsxv3.common.synchronization [req-89d913dd-a89a-4d5c-8b87-45eef6e73919 req-40433ba9-5ef6-4f9a-985d-6a8856edf688 service nova] Enqueued Resource ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e with Priority: HIGHEST for action security_group_rules [ 734.055772] env[70614]: INFO networking_nsxv3.common.synchronization [req-89d913dd-a89a-4d5c-8b87-45eef6e73919 req-40433ba9-5ef6-4f9a-985d-6a8856edf688 service nova] Enqueued Resource ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e with Priority: HIGHEST for action security_group_members [ 734.055963] env[70614]: INFO networking_nsxv3.common.synchronization [req-89d913dd-a89a-4d5c-8b87-45eef6e73919 req-40433ba9-5ef6-4f9a-985d-6a8856edf688 service nova] Enqueued Resource ID: fb5f09a7-2f43-4511-b843-689086b0554a with Priority: HIGHEST for action port [ 734.056567] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e with Priority: HIGHEST for action security_group_rules [ 734.056734] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e with Priority: HIGHEST for action security_group_members [ 734.057062] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb5f09a7-2f43-4511-b843-689086b0554a with Priority: HIGHEST for action port [ 734.057416] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3060abf5-a0d6-4fce-88da-15f03f632b6e taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.057571] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.057758] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.058023] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.058226] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3060abf5-a0d6-4fce-88da-15f03f632b6e',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.059987] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-3060abf5-a0d6-4fce-88da-15f03f632b6e taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.059987] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.059987] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.059987] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.060324] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.060324] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.060417] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.060778] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.060778] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.060778] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3060abf5-a0d6-4fce-88da-15f03f632b6e',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.063667] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb5f09a7-2f43-4511-b843-689086b0554a taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.063667] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb5f09a7-2f43-4511-b843-689086b0554a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.063667] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb5f09a7-2f43-4511-b843-689086b0554a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.063667] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb5f09a7-2f43-4511-b843-689086b0554a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.063667] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb5f09a7-2f43-4511-b843-689086b0554a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.064571] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 406660af-f92d-476c-ab5f-e3168c58847d in Status: SUCCESS [ 734.064778] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.065336] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.065664] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.065721] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.065848] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.066062] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.066145] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.066265] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.066377] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('406660af-f92d-476c-ab5f-e3168c58847d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.161901] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('81470f34-f44d-4111-b9a8-fc43c119e1dd',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.366449] env[70614]: INFO networking_nsxv3.common.synchronization [req-9b56e8a9-538b-4e97-a631-d44009d135d2 req-b48be9ad-93db-4ed2-8df9-b58b7669d4e5 tempest-ServersTestJSON-658318484 tempest-ServersTestJSON-658318484-project-member] Enqueued Resource ID: 428bc8ce-d8af-4c27-9ff7-291210f88a0a with Priority: HIGHEST for action security_group_members [ 734.366449] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 428bc8ce-d8af-4c27-9ff7-291210f88a0a with Priority: HIGHEST for action security_group_members [ 734.366449] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-428bc8ce-d8af-4c27-9ff7-291210f88a0a taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.366449] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-428bc8ce-d8af-4c27-9ff7-291210f88a0a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.366449] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-428bc8ce-d8af-4c27-9ff7-291210f88a0a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.367268] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-428bc8ce-d8af-4c27-9ff7-291210f88a0a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.367268] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.367268] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.367268] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.367529] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.367529] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.367529] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('428bc8ce-d8af-4c27-9ff7-291210f88a0a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.565186] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-3060abf5-a0d6-4fce-88da-15f03f632b6e taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.565419] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.567757] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fb5f09a7-2f43-4511-b843-689086b0554a with status ACTIVE [ 734.567985] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.568146] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.568217] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.568501] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.568650] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.568959] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.569175] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.569301] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.569566] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.570162] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.570162] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.570162] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.570162] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.570330] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.570361] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.570576] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fb5f09a7-2f43-4511-b843-689086b0554a is going to be updated. [ 734.572331] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3060abf5-a0d6-4fce-88da-15f03f632b6e',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.573803] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('406660af-f92d-476c-ab5f-e3168c58847d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.599369] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.599369] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.599369] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.599691] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.599691] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.599888] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb5f09a7-2f43-4511-b843-689086b0554a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.670439] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.670439] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.670439] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.670439] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.670439] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.670439] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81470f34-f44d-4111-b9a8-fc43c119e1dd is going to be updated. [ 734.726668] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.726668] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.726668] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.726668] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.726668] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.740658] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81470f34-f44d-4111-b9a8-fc43c119e1dd in Status: IN_PROGRESS for 2s [ 734.873668] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.873790] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.874071] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.874101] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.874192] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.874399] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.874515] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.874580] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.874733] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.874800] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.874888] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 428bc8ce-d8af-4c27-9ff7-291210f88a0a already deleted. [ 734.876322] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-428bc8ce-d8af-4c27-9ff7-291210f88a0a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.048387] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55f254c4-5a5d-440f-958c-5fd96778e473 in Status: SUCCESS [ 735.048896] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55f254c4-5a5d-440f-958c-5fd96778e473" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.049208] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55f254c4-5a5d-440f-958c-5fd96778e473" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.049511] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55f254c4-5a5d-440f-958c-5fd96778e473" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.049722] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.049846] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.049914] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.050152] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.050223] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.050314] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55f254c4-5a5d-440f-958c-5fd96778e473" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.050414] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('55f254c4-5a5d-440f-958c-5fd96778e473',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.053384] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 in Status: SUCCESS [ 735.054157] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.054157] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55f254c4-5a5d-440f-958c-5fd96778e473" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.054157] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55f254c4-5a5d-440f-958c-5fd96778e473" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.055695] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.055695] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.055695] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.055695] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.055695] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.055695] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55f254c4-5a5d-440f-958c-5fd96778e473',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.057457] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.057850] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.058112] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.058381] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.058492] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.058956] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.058956] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.059069] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.059482] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1440acfc-c5d6-4a44-b0a8-654c4f16a7d1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.060353] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.060569] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.061689] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.061743] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.062302] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.062302] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.062302] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.062302] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1440acfc-c5d6-4a44-b0a8-654c4f16a7d1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.075737] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3060abf5-a0d6-4fce-88da-15f03f632b6e',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.079508] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('406660af-f92d-476c-ab5f-e3168c58847d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.365024] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-2 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.365024] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.365024] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.365024] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.365481] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.365895] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.366119] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.366437] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.366690] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.366985] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 735.367241] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 735.367441] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 735.369018] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 735.369018] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 735.369018] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 735.369018] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 735.394135] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 735.397025] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 735.397025] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 735.397025] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.397025] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-c66f168f-441a-4c7c-806b-18db24809ad8 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.397025] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-c66f168f-441a-4c7c-806b-18db24809ad8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.397025] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-c66f168f-441a-4c7c-806b-18db24809ad8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.397025] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-c66f168f-441a-4c7c-806b-18db24809ad8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.397025] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c66f168f-441a-4c7c-806b-18db24809ad8',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.554427] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('55f254c4-5a5d-440f-958c-5fd96778e473',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.557850] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('55f254c4-5a5d-440f-958c-5fd96778e473',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.565708] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1440acfc-c5d6-4a44-b0a8-654c4f16a7d1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.565708] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.565708] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.580283] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.580474] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.580582] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.580829] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.580949] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.581083] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e is going to be created. [ 735.582930] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.583021] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.587350] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.587350] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.587350] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.587350] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 406660af-f92d-476c-ab5f-e3168c58847d is going to be updated. [ 735.609319] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.609495] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.609579] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.609830] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.609941] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.614069] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.614388] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.614495] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.614846] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.615070] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.624921] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 406660af-f92d-476c-ab5f-e3168c58847d in Status: IN_PROGRESS for 2s [ 735.624921] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e in Status: UNINITIALIZED for 2s [ 735.679097] env[70614]: INFO networking_nsxv3.common.synchronization [req-f3eeda55-ba1e-4a28-8ba3-5748201b5148 req-b0a3a7dd-4f6c-43d4-b990-8338c06b9ff5 tempest-ImagesOneServerTestJSON-416271023 tempest-ImagesOneServerTestJSON-416271023-project-member] Enqueued Resource ID: 03fa4ca9-532b-43b0-bd53-de11eea0a016 with Priority: HIGHEST for action security_group_members [ 735.683846] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03fa4ca9-532b-43b0-bd53-de11eea0a016 with Priority: HIGHEST for action security_group_members [ 735.684427] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-03fa4ca9-532b-43b0-bd53-de11eea0a016 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.684626] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03fa4ca9-532b-43b0-bd53-de11eea0a016" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.684737] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03fa4ca9-532b-43b0-bd53-de11eea0a016" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.685048] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03fa4ca9-532b-43b0-bd53-de11eea0a016" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.688801] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.688801] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.688801] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.688801] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.688801] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.688801] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('03fa4ca9-532b-43b0-bd53-de11eea0a016',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.715543] env[70614]: INFO networking_nsxv3.common.synchronization [None req-339f0ad3-afb0-48fd-913b-db2070fa75f3 None None] Enqueued Resource ID: 088feb99-fdec-4d97-95d8-9212712c6ca9 with Priority: HIGHEST for action port [ 735.717632] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 088feb99-fdec-4d97-95d8-9212712c6ca9 with Priority: HIGHEST for action port [ 735.720017] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-088feb99-fdec-4d97-95d8-9212712c6ca9 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.720186] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-088feb99-fdec-4d97-95d8-9212712c6ca9" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.720281] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-088feb99-fdec-4d97-95d8-9212712c6ca9" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.720619] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-088feb99-fdec-4d97-95d8-9212712c6ca9" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.720734] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('088feb99-fdec-4d97-95d8-9212712c6ca9',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.902650] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.903029] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.903029] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.903326] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.903474] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.903629] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port c66f168f-441a-4c7c-806b-18db24809ad8 not found, creating... [ 735.903894] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.904071] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.904261] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.904428] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.904565] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.904877] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.905198] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.905377] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.905598] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.905732] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.905919] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: c66f168f-441a-4c7c-806b-18db24809ad8 is going to be created. [ 735.930675] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.931028] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.931227] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.931603] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.931856] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.932198] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-c66f168f-441a-4c7c-806b-18db24809ad8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.990130] env[70614]: INFO networking_nsxv3.common.synchronization [req-9c50c14a-aa00-48ac-af15-4c52e7c6cc96 req-af0f0295-22c1-41eb-bd56-77fcfb5cccf3 tempest-FloatingIPsAssociationTestJSON-514222769 tempest-FloatingIPsAssociationTestJSON-514222769-project-member] Enqueued Resource ID: f0060547-03fb-4d1a-ad8e-69519760b908 with Priority: HIGHEST for action security_group_members [ 735.990788] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0060547-03fb-4d1a-ad8e-69519760b908 with Priority: HIGHEST for action security_group_members [ 735.991127] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0060547-03fb-4d1a-ad8e-69519760b908 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.991256] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0060547-03fb-4d1a-ad8e-69519760b908" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.992267] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0060547-03fb-4d1a-ad8e-69519760b908" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.992267] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0060547-03fb-4d1a-ad8e-69519760b908" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.992737] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.992810] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.992851] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.993085] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.993180] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.993300] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0060547-03fb-4d1a-ad8e-69519760b908',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.056851] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 55f254c4-5a5d-440f-958c-5fd96778e473: rpc.has_security_group_logging(os_id): False [ 736.061121] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('55f254c4-5a5d-440f-958c-5fd96778e473',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.066059] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1440acfc-c5d6-4a44-b0a8-654c4f16a7d1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.104165] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.104395] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.104491] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.104796] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.104892] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.105842] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.105842] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.105842] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.105842] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.105842] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.105842] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55f254c4-5a5d-440f-958c-5fd96778e473 is going to be created. [ 736.189374] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.189374] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.189542] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.191792] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.191792] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.191792] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.191792] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.191792] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.191792] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.191792] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.191792] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03fa4ca9-532b-43b0-bd53-de11eea0a016 is going to be updated. [ 736.208364] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.208546] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.208617] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.208843] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.209048] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.225533] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 088feb99-fdec-4d97-95d8-9212712c6ca9 [ 736.225813] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.225976] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.226118] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.226445] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.226445] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.226643] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:088feb99-fdec-4d97-95d8-9212712c6ca9 already deleted. [ 736.226684] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-088feb99-fdec-4d97-95d8-9212712c6ca9" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.233471] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55f254c4-5a5d-440f-958c-5fd96778e473 in Status: IN_PROGRESS for 2s [ 736.241916] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.241916] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.241916] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.242200] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.242359] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.257790] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03fa4ca9-532b-43b0-bd53-de11eea0a016 in Status: IN_PROGRESS for 2s [ 736.495679] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f0060547-03fb-4d1a-ad8e-69519760b908',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.563394] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.563668] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.563668] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.564126] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.564126] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.564126] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55f254c4-5a5d-440f-958c-5fd96778e473 is going to be updated. [ 736.568498] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.568697] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.568697] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.568854] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.568959] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.569162] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 is going to be updated. [ 736.601535] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.601535] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.601535] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.601535] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.601535] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.603014] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.603603] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.603856] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.605243] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.606168] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.618824] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 in Status: IN_PROGRESS for 2s [ 736.620088] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55f254c4-5a5d-440f-958c-5fd96778e473 in Status: IN_PROGRESS for 2s [ 736.752383] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81470f34-f44d-4111-b9a8-fc43c119e1dd in Status: SUCCESS [ 736.752383] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81470f34-f44d-4111-b9a8-fc43c119e1dd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.752383] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81470f34-f44d-4111-b9a8-fc43c119e1dd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.752383] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81470f34-f44d-4111-b9a8-fc43c119e1dd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.752383] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.752383] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.752383] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.752383] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.752383] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.752383] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81470f34-f44d-4111-b9a8-fc43c119e1dd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.752383] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('81470f34-f44d-4111-b9a8-fc43c119e1dd',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.806376] env[70614]: INFO networking_nsxv3.common.synchronization [req-9b56e8a9-538b-4e97-a631-d44009d135d2 req-0e7af81e-dea4-43ac-948a-f512d30f347c service nova] Enqueued Resource ID: 428bc8ce-d8af-4c27-9ff7-291210f88a0a with Priority: HIGHEST for action security_group_rules [ 736.806560] env[70614]: INFO networking_nsxv3.common.synchronization [req-9b56e8a9-538b-4e97-a631-d44009d135d2 req-0e7af81e-dea4-43ac-948a-f512d30f347c service nova] Enqueued Resource ID: 428bc8ce-d8af-4c27-9ff7-291210f88a0a with Priority: HIGHEST for action security_group_members [ 736.806695] env[70614]: INFO networking_nsxv3.common.synchronization [req-9b56e8a9-538b-4e97-a631-d44009d135d2 req-0e7af81e-dea4-43ac-948a-f512d30f347c service nova] Enqueued Resource ID: c66f168f-441a-4c7c-806b-18db24809ad8 with Priority: HIGHEST for action port [ 736.806926] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 428bc8ce-d8af-4c27-9ff7-291210f88a0a with Priority: HIGHEST for action security_group_rules [ 736.807097] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 428bc8ce-d8af-4c27-9ff7-291210f88a0a with Priority: HIGHEST for action security_group_members [ 736.807209] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c66f168f-441a-4c7c-806b-18db24809ad8 with Priority: HIGHEST for action port [ 736.809837] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-428bc8ce-d8af-4c27-9ff7-291210f88a0a taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.809837] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-428bc8ce-d8af-4c27-9ff7-291210f88a0a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.809837] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-428bc8ce-d8af-4c27-9ff7-291210f88a0a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.809837] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-428bc8ce-d8af-4c27-9ff7-291210f88a0a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.809837] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('428bc8ce-d8af-4c27-9ff7-291210f88a0a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.810277] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-428bc8ce-d8af-4c27-9ff7-291210f88a0a taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.810277] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-428bc8ce-d8af-4c27-9ff7-291210f88a0a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.811539] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-428bc8ce-d8af-4c27-9ff7-291210f88a0a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.811539] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-428bc8ce-d8af-4c27-9ff7-291210f88a0a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.811539] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.811539] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.811539] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.811539] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.811770] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.811770] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('428bc8ce-d8af-4c27-9ff7-291210f88a0a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.812625] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-c66f168f-441a-4c7c-806b-18db24809ad8 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.812714] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c66f168f-441a-4c7c-806b-18db24809ad8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.812761] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c66f168f-441a-4c7c-806b-18db24809ad8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.812871] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c66f168f-441a-4c7c-806b-18db24809ad8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.812976] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c66f168f-441a-4c7c-806b-18db24809ad8',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.001277] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f0060547-03fb-4d1a-ad8e-69519760b908',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.254062] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('81470f34-f44d-4111-b9a8-fc43c119e1dd',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.314780] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-428bc8ce-d8af-4c27-9ff7-291210f88a0a taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.314780] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-428bc8ce-d8af-4c27-9ff7-291210f88a0a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.314986] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('428bc8ce-d8af-4c27-9ff7-291210f88a0a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.315998] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c66f168f-441a-4c7c-806b-18db24809ad8 with status ACTIVE [ 737.316206] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.316326] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.316394] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.316593] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.316679] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.316846] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.316942] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.317020] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.317695] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.317695] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.317695] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.317824] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.317824] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.321019] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.321019] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.321019] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c66f168f-441a-4c7c-806b-18db24809ad8 is going to be updated. [ 737.344648] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.344964] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.344964] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.345209] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.345375] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.345961] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c66f168f-441a-4c7c-806b-18db24809ad8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.449259] env[70614]: INFO networking_nsxv3.common.synchronization [req-4cf952c4-aa6e-4627-a22b-1e4a4966233a req-0c36d125-e673-4319-94f1-f7babbf58224 tempest-AttachInterfacesTestJSON-1919943007 tempest-AttachInterfacesTestJSON-1919943007-project-member] Enqueued Resource ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 with Priority: HIGHEST for action security_group_members [ 737.450626] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 with Priority: HIGHEST for action security_group_members [ 737.450956] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d3a5ad0-c473-4d61-9101-9c7582c27390 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.451197] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.451272] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.451548] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.451720] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.452447] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.452447] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.452447] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.452447] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.452614] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d3a5ad0-c473-4d61-9101-9c7582c27390',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.504228] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.504410] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.504494] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.504799] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.504975] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.505198] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0060547-03fb-4d1a-ad8e-69519760b908 is going to be updated. [ 737.540548] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.540548] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.540548] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.540814] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.540814] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.551375] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0060547-03fb-4d1a-ad8e-69519760b908 in Status: IN_PROGRESS for 2s [ 737.641042] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 406660af-f92d-476c-ab5f-e3168c58847d in Status: SUCCESS [ 737.641042] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.641042] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.641042] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.641042] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.641042] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.641042] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.641042] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.641042] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.641042] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.641042] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('406660af-f92d-476c-ab5f-e3168c58847d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.645828] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e in Status: SUCCESS [ 737.646176] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.646442] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.646745] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.647122] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.647430] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.647601] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.647885] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.648064] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.648265] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.648442] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3060abf5-a0d6-4fce-88da-15f03f632b6e',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.759674] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 81470f34-f44d-4111-b9a8-fc43c119e1dd: rpc.has_security_group_logging(os_id): False [ 737.781024] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.781024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.781024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.781024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.781024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.781024] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.781024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.781024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.781024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.781024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.781024] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 81470f34-f44d-4111-b9a8-fc43c119e1dd is going to be created. [ 737.820411] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('428bc8ce-d8af-4c27-9ff7-291210f88a0a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.835218] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.837975] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.840265] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.840265] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.840265] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.854961] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 81470f34-f44d-4111-b9a8-fc43c119e1dd in Status: IN_PROGRESS for 2s [ 737.955183] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.955392] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.955498] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.955822] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.956130] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.956408] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.956758] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.956831] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.957014] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.957169] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.957274] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 is going to be updated. [ 737.984947] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.984947] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.985174] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.985838] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.985838] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.999775] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 in Status: IN_PROGRESS for 2s [ 738.145818] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-406660af-f92d-476c-ab5f-e3168c58847d taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.146177] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.146177] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.146394] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.146503] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.146605] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.146669] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.146823] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.146911] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.147010] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.147198] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-406660af-f92d-476c-ab5f-e3168c58847d taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.147342] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.147383] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.147743] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.147743] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.147919] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.147919] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.148023] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.148115] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.148214] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.148294] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('406660af-f92d-476c-ab5f-e3168c58847d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.151442] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-3060abf5-a0d6-4fce-88da-15f03f632b6e taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.151677] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.151817] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.152158] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.152459] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.152617] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.152731] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.153016] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.153134] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.153302] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.153513] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-3060abf5-a0d6-4fce-88da-15f03f632b6e taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.153671] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.153791] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.153999] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.154256] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.154414] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.154664] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.154898] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.155117] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.155296] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.155453] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3060abf5-a0d6-4fce-88da-15f03f632b6e',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.248139] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55f254c4-5a5d-440f-958c-5fd96778e473 in Status: SUCCESS [ 738.248421] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55f254c4-5a5d-440f-958c-5fd96778e473" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.248597] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55f254c4-5a5d-440f-958c-5fd96778e473" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.248806] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55f254c4-5a5d-440f-958c-5fd96778e473" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.248896] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55f254c4-5a5d-440f-958c-5fd96778e473',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.268692] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03fa4ca9-532b-43b0-bd53-de11eea0a016 in Status: SUCCESS [ 738.268866] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03fa4ca9-532b-43b0-bd53-de11eea0a016 deletion is rescheduled due to dependency. [ 738.268986] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03fa4ca9-532b-43b0-bd53-de11eea0a016" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.323533] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.323713] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.323793] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.324020] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.324228] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.324353] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 428bc8ce-d8af-4c27-9ff7-291210f88a0a is going to be created. [ 738.351505] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.351505] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.351505] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.351682] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.351873] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.365593] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 428bc8ce-d8af-4c27-9ff7-291210f88a0a in Status: UNINITIALIZED for 2s [ 738.631805] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55f254c4-5a5d-440f-958c-5fd96778e473 in Status: SUCCESS [ 738.632044] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55f254c4-5a5d-440f-958c-5fd96778e473" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.632218] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55f254c4-5a5d-440f-958c-5fd96778e473" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.632499] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55f254c4-5a5d-440f-958c-5fd96778e473" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.632643] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.632765] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.632834] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.633012] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.633158] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.633199] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55f254c4-5a5d-440f-958c-5fd96778e473',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.634680] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 in Status: SUCCESS [ 738.634864] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.635068] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.635232] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.635590] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.635590] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.635590] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.635722] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.635781] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.635857] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1440acfc-c5d6-4a44-b0a8-654c4f16a7d1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.650997] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 406660af-f92d-476c-ab5f-e3168c58847d: rpc.has_security_group_logging(os_id): False [ 738.659447] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3060abf5-a0d6-4fce-88da-15f03f632b6e: rpc.has_security_group_logging(os_id): False [ 738.672010] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.672371] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.672566] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.672907] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.673895] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.674272] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.674437] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.674530] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.675878] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.675878] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.675878] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.675878] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.675878] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.675878] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.675878] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.676240] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.676389] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.676521] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.676719] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.676807] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.676912] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 406660af-f92d-476c-ab5f-e3168c58847d is going to be updated. [ 738.679543] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.679699] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.679775] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.679919] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.680028] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.680185] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.680303] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.680484] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.680484] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.680591] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.680784] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.680894] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.680956] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.681191] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.681280] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.681491] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.681604] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.681675] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.681842] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.681889] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.681999] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e is going to be created. [ 738.751862] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-55f254c4-5a5d-440f-958c-5fd96778e473 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.751862] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55f254c4-5a5d-440f-958c-5fd96778e473" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.759030] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.759030] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.760177] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.760177] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.760177] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.762955] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.764343] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.764343] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.764546] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.764862] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.783449] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e in Status: IN_PROGRESS for 2s [ 738.786995] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 406660af-f92d-476c-ab5f-e3168c58847d in Status: IN_PROGRESS for 2s [ 739.137420] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('55f254c4-5a5d-440f-958c-5fd96778e473',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.139039] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1440acfc-c5d6-4a44-b0a8-654c4f16a7d1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.562022] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0060547-03fb-4d1a-ad8e-69519760b908 in Status: SUCCESS [ 739.562302] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0060547-03fb-4d1a-ad8e-69519760b908" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.643580] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('55f254c4-5a5d-440f-958c-5fd96778e473',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.644607] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1440acfc-c5d6-4a44-b0a8-654c4f16a7d1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.867486] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 81470f34-f44d-4111-b9a8-fc43c119e1dd in Status: SUCCESS [ 739.869579] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-81470f34-f44d-4111-b9a8-fc43c119e1dd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.011822] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 in Status: SUCCESS [ 740.011822] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 deletion is rescheduled due to dependency. [ 740.011822] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.146561] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.146713] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.146783] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.147037] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.147139] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.147249] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55f254c4-5a5d-440f-958c-5fd96778e473 is going to be updated. [ 740.148571] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.151022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.151022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.151022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.151022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.151022] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 is going to be updated. [ 740.191205] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.191409] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.191409] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.191614] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.191755] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.193642] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.193758] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.193828] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.194072] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.194233] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.210111] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55f254c4-5a5d-440f-958c-5fd96778e473 in Status: IN_PROGRESS for 2s [ 740.210856] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 in Status: IN_PROGRESS for 2s [ 740.375535] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 428bc8ce-d8af-4c27-9ff7-291210f88a0a in Status: SUCCESS [ 740.375833] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-428bc8ce-d8af-4c27-9ff7-291210f88a0a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.376018] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-428bc8ce-d8af-4c27-9ff7-291210f88a0a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.376240] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-428bc8ce-d8af-4c27-9ff7-291210f88a0a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.376448] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.376568] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.376644] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.376786] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.376866] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.376953] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-428bc8ce-d8af-4c27-9ff7-291210f88a0a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.377055] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('428bc8ce-d8af-4c27-9ff7-291210f88a0a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.531878] env[70614]: INFO networking_nsxv3.common.synchronization [req-560d62ad-8c87-40bf-a81d-84ad97fa19b7 req-d453f0bd-cc98-4bb3-969c-b6c6fa4cf54a tempest-AttachInterfacesV270Test-1136727211 tempest-AttachInterfacesV270Test-1136727211-project-member] Enqueued Resource ID: 3177f360-f74b-456a-9c1b-681726056f53 with Priority: HIGHEST for action security_group_members [ 740.532977] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3177f360-f74b-456a-9c1b-681726056f53 with Priority: HIGHEST for action security_group_members [ 740.533626] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-3177f360-f74b-456a-9c1b-681726056f53 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.534012] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3177f360-f74b-456a-9c1b-681726056f53" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.534241] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3177f360-f74b-456a-9c1b-681726056f53" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.534731] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3177f360-f74b-456a-9c1b-681726056f53" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.535124] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.535511] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.535717] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.536087] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.536342] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.536602] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3177f360-f74b-456a-9c1b-681726056f53',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.803028] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e in Status: SUCCESS [ 740.803028] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.803028] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 406660af-f92d-476c-ab5f-e3168c58847d in Status: SUCCESS [ 740.803554] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.803554] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.803554] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.803695] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('406660af-f92d-476c-ab5f-e3168c58847d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.879710] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('428bc8ce-d8af-4c27-9ff7-291210f88a0a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.041116] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.041116] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.041116] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.041116] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.041654] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.043969] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.045341] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.045341] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.045341] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.045341] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.045341] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3177f360-f74b-456a-9c1b-681726056f53 already deleted. [ 741.045341] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3177f360-f74b-456a-9c1b-681726056f53" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.191194] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-860 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.191497] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-860" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.191664] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-860" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.194583] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-860" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.195037] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.195280] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.195467] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.195776] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.195935] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.196186] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 741.196329] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 741.196462] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 741.196573] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 741.196700] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 741.196849] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 741.196997] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 741.221776] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 741.221996] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 741.222192] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 741.222483] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-860" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.222927] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-c2b961fe-9a8d-4369-989f-537f97509bfd taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.223154] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-c2b961fe-9a8d-4369-989f-537f97509bfd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.223336] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-c2b961fe-9a8d-4369-989f-537f97509bfd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.224478] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-c2b961fe-9a8d-4369-989f-537f97509bfd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.224700] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2b961fe-9a8d-4369-989f-537f97509bfd',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.307258] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-406660af-f92d-476c-ab5f-e3168c58847d taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.309385] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.309385] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.309385] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.309385] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.309385] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.309385] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.309385] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.309385] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.309385] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.309385] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('406660af-f92d-476c-ab5f-e3168c58847d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.385034] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 428bc8ce-d8af-4c27-9ff7-291210f88a0a: rpc.has_security_group_logging(os_id): False [ 741.409899] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.409899] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.410019] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.410237] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.411041] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.411041] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.411041] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.411041] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.411041] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.411041] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.411563] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 428bc8ce-d8af-4c27-9ff7-291210f88a0a is going to be created. [ 741.515434] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.516345] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.516345] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.516345] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.516345] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.536948] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 428bc8ce-d8af-4c27-9ff7-291210f88a0a in Status: IN_PROGRESS for 2s [ 741.728526] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.729154] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.729403] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.729777] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.730040] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.730658] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port c2b961fe-9a8d-4369-989f-537f97509bfd not found, creating... [ 741.730658] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.730849] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.731102] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.731357] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.731505] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.731812] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.731969] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.733307] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.733431] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.733829] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.733829] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: c2b961fe-9a8d-4369-989f-537f97509bfd is going to be created. [ 741.759722] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.759990] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.759990] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.760279] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.760515] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.760747] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-c2b961fe-9a8d-4369-989f-537f97509bfd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.815530] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-406660af-f92d-476c-ab5f-e3168c58847d taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.816609] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.816609] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.816609] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.817168] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.817313] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.817378] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.817557] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.817651] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.817738] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.817928] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-406660af-f92d-476c-ab5f-e3168c58847d taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.818032] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.818100] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.818260] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.818413] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.818604] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.818604] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.818732] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.818794] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.818862] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.818937] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('406660af-f92d-476c-ab5f-e3168c58847d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.223688] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55f254c4-5a5d-440f-958c-5fd96778e473 in Status: SUCCESS [ 742.223925] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55f254c4-5a5d-440f-958c-5fd96778e473" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.224113] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55f254c4-5a5d-440f-958c-5fd96778e473" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.224335] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55f254c4-5a5d-440f-958c-5fd96778e473" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.224579] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.224701] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.224769] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.224940] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.225037] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.225129] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55f254c4-5a5d-440f-958c-5fd96778e473" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.225219] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('55f254c4-5a5d-440f-958c-5fd96778e473',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.227295] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 in Status: SUCCESS [ 742.227886] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.228165] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.228449] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.228949] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.229088] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.229160] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.229335] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.229417] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.229528] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.233027] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.233027] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.233027] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.233027] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.233027] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.233027] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.233027] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.233027] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.233027] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.233027] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.233027] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1440acfc-c5d6-4a44-b0a8-654c4f16a7d1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.283094] env[70614]: INFO networking_nsxv3.common.synchronization [req-75c0abd9-ebe9-4fc2-8c31-21a5b9e3d9f5 req-3ca3e42e-74b3-4d26-a215-cfcea9f330d5 tempest-AttachInterfacesTestJSON-1919943007 tempest-AttachInterfacesTestJSON-1919943007-project-member] Enqueued Resource ID: ebcad34a-a932-4aaf-93de-b0493166d0cf with Priority: HIGHEST for action security_group_members [ 742.283798] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebcad34a-a932-4aaf-93de-b0493166d0cf with Priority: HIGHEST for action security_group_members [ 742.284063] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebcad34a-a932-4aaf-93de-b0493166d0cf taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.284647] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebcad34a-a932-4aaf-93de-b0493166d0cf" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.284749] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebcad34a-a932-4aaf-93de-b0493166d0cf" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.284956] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebcad34a-a932-4aaf-93de-b0493166d0cf" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.285151] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.285261] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.285358] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.285482] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.285571] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.285675] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebcad34a-a932-4aaf-93de-b0493166d0cf',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.322791] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 406660af-f92d-476c-ab5f-e3168c58847d: rpc.has_security_group_logging(os_id): False [ 742.341096] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.341435] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.341435] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.341720] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.341720] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.341882] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.341964] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.342045] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.342251] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.342338] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.342591] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.342751] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.342751] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.342907] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.343058] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.343309] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.343445] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.343522] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.343688] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.343795] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.343901] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 406660af-f92d-476c-ab5f-e3168c58847d is going to be updated. [ 742.407170] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.407483] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.407568] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.407762] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.407913] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.423418] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 406660af-f92d-476c-ab5f-e3168c58847d in Status: IN_PROGRESS for 2s [ 742.596403] env[70614]: INFO networking_nsxv3.common.synchronization [req-560d62ad-8c87-40bf-a81d-84ad97fa19b7 req-f1104b59-0976-4c7c-a8f7-b1cc5038e6a5 service nova] Enqueued Resource ID: 3177f360-f74b-456a-9c1b-681726056f53 with Priority: HIGHEST for action security_group_rules [ 742.596592] env[70614]: INFO networking_nsxv3.common.synchronization [req-560d62ad-8c87-40bf-a81d-84ad97fa19b7 req-f1104b59-0976-4c7c-a8f7-b1cc5038e6a5 service nova] Enqueued Resource ID: 3177f360-f74b-456a-9c1b-681726056f53 with Priority: HIGHEST for action security_group_members [ 742.596728] env[70614]: INFO networking_nsxv3.common.synchronization [req-560d62ad-8c87-40bf-a81d-84ad97fa19b7 req-f1104b59-0976-4c7c-a8f7-b1cc5038e6a5 service nova] Enqueued Resource ID: c2b961fe-9a8d-4369-989f-537f97509bfd with Priority: HIGHEST for action port [ 742.597370] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3177f360-f74b-456a-9c1b-681726056f53 with Priority: HIGHEST for action security_group_rules [ 742.597370] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3177f360-f74b-456a-9c1b-681726056f53 with Priority: HIGHEST for action security_group_members [ 742.597370] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2b961fe-9a8d-4369-989f-537f97509bfd with Priority: HIGHEST for action port [ 742.601681] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3177f360-f74b-456a-9c1b-681726056f53 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.601681] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3177f360-f74b-456a-9c1b-681726056f53" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.601681] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3177f360-f74b-456a-9c1b-681726056f53" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.601970] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3177f360-f74b-456a-9c1b-681726056f53" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.602080] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3177f360-f74b-456a-9c1b-681726056f53',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.603110] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-3177f360-f74b-456a-9c1b-681726056f53 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.603243] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3177f360-f74b-456a-9c1b-681726056f53" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.603313] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3177f360-f74b-456a-9c1b-681726056f53" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.603508] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3177f360-f74b-456a-9c1b-681726056f53" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.603669] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.603772] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.603834] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.603975] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.604073] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.604170] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3177f360-f74b-456a-9c1b-681726056f53',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.610766] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-c2b961fe-9a8d-4369-989f-537f97509bfd taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.610766] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c2b961fe-9a8d-4369-989f-537f97509bfd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.610766] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c2b961fe-9a8d-4369-989f-537f97509bfd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.610766] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c2b961fe-9a8d-4369-989f-537f97509bfd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.610956] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2b961fe-9a8d-4369-989f-537f97509bfd',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.733420] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('55f254c4-5a5d-440f-958c-5fd96778e473',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.737069] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1: rpc.has_security_group_logging(os_id): False [ 742.755860] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.756043] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.756176] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.756507] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.756677] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.757068] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.757268] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.757394] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.757647] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.757797] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.759149] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.759422] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.759656] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.759976] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.760219] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.760641] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.760887] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.761102] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.761411] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.761625] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.761846] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 is going to be updated. [ 742.791200] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.791200] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.791200] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.791485] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.791485] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.791852] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.791852] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.791852] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.791953] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.791979] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.792109] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebcad34a-a932-4aaf-93de-b0493166d0cf is going to be updated. [ 742.821588] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.821588] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.821588] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.821588] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.821588] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.833484] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebcad34a-a932-4aaf-93de-b0493166d0cf in Status: IN_PROGRESS for 2s [ 742.840906] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.841093] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.841169] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.841387] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.841545] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.857236] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 in Status: IN_PROGRESS for 2s [ 743.113109] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3177f360-f74b-456a-9c1b-681726056f53',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.114953] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-3177f360-f74b-456a-9c1b-681726056f53 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.115158] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3177f360-f74b-456a-9c1b-681726056f53" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.116161] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c2b961fe-9a8d-4369-989f-537f97509bfd with status ACTIVE [ 743.116161] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.116161] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.116161] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.116334] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.116442] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.116648] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.116791] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.116875] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.117720] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.117720] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.117720] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.117720] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.117720] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.117720] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.117720] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.117992] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c2b961fe-9a8d-4369-989f-537f97509bfd is going to be updated. [ 743.140518] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.140821] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.140821] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.140930] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.141087] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.141258] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c2b961fe-9a8d-4369-989f-537f97509bfd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.239540] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 55f254c4-5a5d-440f-958c-5fd96778e473: rpc.has_security_group_logging(os_id): False [ 743.267884] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.268358] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.268831] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.273031] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.273031] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.273031] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.276402] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.276402] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.276402] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.276402] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.276402] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55f254c4-5a5d-440f-958c-5fd96778e473 is going to be updated. [ 743.366575] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.368689] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.368689] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.368689] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.368689] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.380695] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55f254c4-5a5d-440f-958c-5fd96778e473 in Status: IN_PROGRESS for 2s [ 743.496184] env[70614]: INFO networking_nsxv3.common.synchronization [req-caae7cf8-ea0c-4865-b953-df24cbb04877 req-c05cf410-f8e0-4543-9ca6-4c3946767ffb tempest-ServerRescueTestJSON-1696153379 tempest-ServerRescueTestJSON-1696153379-project-member] Enqueued Resource ID: 0a55332f-b291-4614-8b34-ee4cd0d39027 with Priority: HIGHEST for action security_group_members [ 743.496184] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a55332f-b291-4614-8b34-ee4cd0d39027 with Priority: HIGHEST for action security_group_members [ 743.496184] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a55332f-b291-4614-8b34-ee4cd0d39027 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.496184] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.496184] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.496648] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.496925] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.497224] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.497392] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.497635] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.497810] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.497986] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a55332f-b291-4614-8b34-ee4cd0d39027',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.686639] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3177f360-f74b-456a-9c1b-681726056f53',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.700025] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 428bc8ce-d8af-4c27-9ff7-291210f88a0a in Status: SUCCESS [ 743.700025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-428bc8ce-d8af-4c27-9ff7-291210f88a0a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.887262] env[70614]: INFO networking_nsxv3.common.synchronization [req-d28aed0b-03e2-4b28-ad35-b7f25358df8c req-e56c8a7e-eeed-48a6-ac8c-95159fba7880 tempest-ListServersNegativeTestJSON-1075096126 tempest-ListServersNegativeTestJSON-1075096126-project-member] Enqueued Resource ID: 406660af-f92d-476c-ab5f-e3168c58847d with Priority: HIGHEST for action security_group_members [ 743.888453] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 406660af-f92d-476c-ab5f-e3168c58847d with Priority: HIGHEST for action security_group_members [ 743.888453] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-406660af-f92d-476c-ab5f-e3168c58847d taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.888588] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.888588] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.888792] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.888958] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.889078] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.889138] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.889288] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.889370] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.889494] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('406660af-f92d-476c-ab5f-e3168c58847d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.002914] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.003420] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.003420] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.003420] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.003937] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.003937] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.003937] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.003937] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.004205] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.004205] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.004291] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a55332f-b291-4614-8b34-ee4cd0d39027 already deleted. [ 744.004332] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.130729] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-328 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.130729] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-328" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.130729] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-328" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.130729] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-328" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.130729] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.130729] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.130729] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.130729] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.130729] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.130729] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 744.130729] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 744.130729] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 744.131287] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 744.131287] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 744.131287] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 744.131287] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 744.153534] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 744.153715] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 744.153849] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 744.154042] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-328" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.154377] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-b70fa6e0-c9a5-4c34-bc53-90dc0ba472ff taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.154556] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-b70fa6e0-c9a5-4c34-bc53-90dc0ba472ff" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.154676] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-b70fa6e0-c9a5-4c34-bc53-90dc0ba472ff" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.155041] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-b70fa6e0-c9a5-4c34-bc53-90dc0ba472ff" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.155220] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b70fa6e0-c9a5-4c34-bc53-90dc0ba472ff',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.189628] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.189709] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.190039] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.190039] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.190142] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.190221] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3177f360-f74b-456a-9c1b-681726056f53 is going to be created. [ 744.219635] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.219822] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.219908] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.220185] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.220354] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.235423] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3177f360-f74b-456a-9c1b-681726056f53 in Status: UNINITIALIZED for 2s [ 744.397301] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('406660af-f92d-476c-ab5f-e3168c58847d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.442972] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 406660af-f92d-476c-ab5f-e3168c58847d in Status: SUCCESS [ 744.443310] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.658636] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.658636] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.658842] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.659102] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.659262] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.659418] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port b70fa6e0-c9a5-4c34-bc53-90dc0ba472ff not found, creating... [ 744.659743] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.659933] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.660196] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.660520] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.660842] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.661042] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.661264] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.661327] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.661718] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.661718] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.661814] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: b70fa6e0-c9a5-4c34-bc53-90dc0ba472ff is going to be created. [ 744.693705] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.693705] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.693705] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.693705] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.693705] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.693705] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-b70fa6e0-c9a5-4c34-bc53-90dc0ba472ff" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.844324] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebcad34a-a932-4aaf-93de-b0493166d0cf in Status: SUCCESS [ 744.844711] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebcad34a-a932-4aaf-93de-b0493166d0cf deletion is rescheduled due to dependency. [ 744.844711] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebcad34a-a932-4aaf-93de-b0493166d0cf" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.872213] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 in Status: SUCCESS [ 744.872434] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.872616] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.872844] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.872939] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1440acfc-c5d6-4a44-b0a8-654c4f16a7d1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.898922] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('406660af-f92d-476c-ab5f-e3168c58847d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.378544] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.378734] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.378776] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.379072] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.379135] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.379239] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.379289] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.381667] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.381667] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.381667] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.381667] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1440acfc-c5d6-4a44-b0a8-654c4f16a7d1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.397542] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55f254c4-5a5d-440f-958c-5fd96778e473 in Status: SUCCESS [ 745.397766] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55f254c4-5a5d-440f-958c-5fd96778e473" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.402836] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.403180] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.403180] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.405017] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.405017] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.405017] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 406660af-f92d-476c-ab5f-e3168c58847d is going to be updated. [ 745.433877] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.434116] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.434228] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.434528] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.434753] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.449645] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 406660af-f92d-476c-ab5f-e3168c58847d in Status: IN_PROGRESS for 2s [ 745.547280] env[70614]: INFO networking_nsxv3.common.synchronization [req-caae7cf8-ea0c-4865-b953-df24cbb04877 req-3a67fdc7-7d40-401e-bf42-59264e29dace service nova] Enqueued Resource ID: 0a55332f-b291-4614-8b34-ee4cd0d39027 with Priority: HIGHEST for action security_group_rules [ 745.547445] env[70614]: INFO networking_nsxv3.common.synchronization [req-caae7cf8-ea0c-4865-b953-df24cbb04877 req-3a67fdc7-7d40-401e-bf42-59264e29dace service nova] Enqueued Resource ID: 0a55332f-b291-4614-8b34-ee4cd0d39027 with Priority: HIGHEST for action security_group_members [ 745.547593] env[70614]: INFO networking_nsxv3.common.synchronization [req-caae7cf8-ea0c-4865-b953-df24cbb04877 req-3a67fdc7-7d40-401e-bf42-59264e29dace service nova] Enqueued Resource ID: b70fa6e0-c9a5-4c34-bc53-90dc0ba472ff with Priority: HIGHEST for action port [ 745.547827] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a55332f-b291-4614-8b34-ee4cd0d39027 with Priority: HIGHEST for action security_group_rules [ 745.547961] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a55332f-b291-4614-8b34-ee4cd0d39027 with Priority: HIGHEST for action security_group_members [ 745.548073] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b70fa6e0-c9a5-4c34-bc53-90dc0ba472ff with Priority: HIGHEST for action port [ 745.548697] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a55332f-b291-4614-8b34-ee4cd0d39027 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.548839] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.548891] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.550410] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.550505] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a55332f-b291-4614-8b34-ee4cd0d39027',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.551942] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a55332f-b291-4614-8b34-ee4cd0d39027 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.552066] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.552143] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.552339] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.552490] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.552597] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.552639] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.552784] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.552878] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.552968] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a55332f-b291-4614-8b34-ee4cd0d39027',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.553772] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-b70fa6e0-c9a5-4c34-bc53-90dc0ba472ff taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.553882] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b70fa6e0-c9a5-4c34-bc53-90dc0ba472ff" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.553947] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b70fa6e0-c9a5-4c34-bc53-90dc0ba472ff" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.554116] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b70fa6e0-c9a5-4c34-bc53-90dc0ba472ff" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.554188] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b70fa6e0-c9a5-4c34-bc53-90dc0ba472ff',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.882338] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.882499] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.882575] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.882792] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.882956] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.883077] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.883148] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.883284] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.883396] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.883530] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.883649] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.883794] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.883859] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.884063] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.884268] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.884406] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.884478] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.884639] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.884724] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.884802] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.884888] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1440acfc-c5d6-4a44-b0a8-654c4f16a7d1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.057739] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a55332f-b291-4614-8b34-ee4cd0d39027',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.059068] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a55332f-b291-4614-8b34-ee4cd0d39027 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.059211] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.059434] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b70fa6e0-c9a5-4c34-bc53-90dc0ba472ff with status ACTIVE [ 746.059640] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.060014] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.060014] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.060147] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.060249] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.060708] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.060708] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.060708] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.061073] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.061073] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.061295] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.061450] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.061637] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.061766] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.061821] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.061863] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b70fa6e0-c9a5-4c34-bc53-90dc0ba472ff is going to be updated. [ 746.084734] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.084734] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.084734] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.084877] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.085034] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.085270] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b70fa6e0-c9a5-4c34-bc53-90dc0ba472ff" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.259241] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3177f360-f74b-456a-9c1b-681726056f53 in Status: SUCCESS [ 746.259602] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3177f360-f74b-456a-9c1b-681726056f53" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.259802] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3177f360-f74b-456a-9c1b-681726056f53" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.260063] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3177f360-f74b-456a-9c1b-681726056f53" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.260267] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.260384] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.260446] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.260614] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.260690] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.260770] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3177f360-f74b-456a-9c1b-681726056f53" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.260857] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3177f360-f74b-456a-9c1b-681726056f53',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.387520] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1: rpc.has_security_group_logging(os_id): False [ 746.415482] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.415675] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.415748] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.415967] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.416072] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.416293] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.416392] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.416455] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.416612] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.416666] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.416837] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.416927] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.416986] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.417144] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.417245] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.417661] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.417661] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.417661] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.417802] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.417802] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.417876] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 is going to be updated. [ 746.512646] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.512803] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.512876] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.513636] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.513636] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.529724] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 in Status: IN_PROGRESS for 2s [ 746.564602] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a55332f-b291-4614-8b34-ee4cd0d39027',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.764134] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-3177f360-f74b-456a-9c1b-681726056f53 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.764134] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3177f360-f74b-456a-9c1b-681726056f53" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.764134] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3177f360-f74b-456a-9c1b-681726056f53" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.764134] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3177f360-f74b-456a-9c1b-681726056f53" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.764134] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.764134] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.764525] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.764525] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.764525] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.764615] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3177f360-f74b-456a-9c1b-681726056f53" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.765094] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-3177f360-f74b-456a-9c1b-681726056f53 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.765094] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3177f360-f74b-456a-9c1b-681726056f53" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.765094] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3177f360-f74b-456a-9c1b-681726056f53" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.765261] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3177f360-f74b-456a-9c1b-681726056f53" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.765484] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.765667] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.765710] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.765885] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.766013] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.766216] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3177f360-f74b-456a-9c1b-681726056f53" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.766362] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3177f360-f74b-456a-9c1b-681726056f53',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.068149] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.068149] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.068149] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.068149] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.068149] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.068149] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a55332f-b291-4614-8b34-ee4cd0d39027 is going to be created. [ 747.100104] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.100317] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.100317] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.101325] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.101325] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.115094] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a55332f-b291-4614-8b34-ee4cd0d39027 in Status: UNINITIALIZED for 2s [ 747.269442] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3177f360-f74b-456a-9c1b-681726056f53: rpc.has_security_group_logging(os_id): False [ 747.289962] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.290183] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.290183] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.290524] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.290524] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.290701] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.290812] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.290903] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.291018] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.291098] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.291098] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.291098] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.291098] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.291098] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.291098] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.291098] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.292307] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.292307] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.292307] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.292307] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.292307] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3177f360-f74b-456a-9c1b-681726056f53 is going to be created. [ 747.363119] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.363119] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.363119] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.363119] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.363451] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.377078] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3177f360-f74b-456a-9c1b-681726056f53 in Status: IN_PROGRESS for 2s [ 747.463898] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 406660af-f92d-476c-ab5f-e3168c58847d in Status: SUCCESS [ 747.464255] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.546430] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 in Status: SUCCESS [ 748.546806] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.091942] env[70614]: INFO networking_nsxv3.common.synchronization [req-12fac734-5599-4144-a1eb-9b83be555f66 req-94a69836-7a60-40b0-850b-dadb574042e6 tempest-InstanceActionsV221TestJSON-747316391 tempest-InstanceActionsV221TestJSON-747316391-project-member] Enqueued Resource ID: ec4cc5da-964e-43e8-9531-6581ec387b4d with Priority: HIGHEST for action security_group_members [ 749.092725] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec4cc5da-964e-43e8-9531-6581ec387b4d with Priority: HIGHEST for action security_group_members [ 749.094586] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec4cc5da-964e-43e8-9531-6581ec387b4d taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.094586] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec4cc5da-964e-43e8-9531-6581ec387b4d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.094586] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec4cc5da-964e-43e8-9531-6581ec387b4d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.094795] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec4cc5da-964e-43e8-9531-6581ec387b4d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.094971] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.095117] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.095165] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.095323] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.095449] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.095498] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec4cc5da-964e-43e8-9531-6581ec387b4d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.127159] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a55332f-b291-4614-8b34-ee4cd0d39027 in Status: SUCCESS [ 749.127418] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.127969] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.128218] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.128427] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.128576] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.128649] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.128804] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.128974] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.128974] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.129080] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0a55332f-b291-4614-8b34-ee4cd0d39027',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.392556] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3177f360-f74b-456a-9c1b-681726056f53 in Status: SUCCESS [ 749.392653] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3177f360-f74b-456a-9c1b-681726056f53" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.599312] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.599690] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.599801] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.600045] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.600138] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.600350] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.600452] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.600512] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.600721] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.600820] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.600948] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec4cc5da-964e-43e8-9531-6581ec387b4d already deleted. [ 749.601094] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec4cc5da-964e-43e8-9531-6581ec387b4d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.633506] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a55332f-b291-4614-8b34-ee4cd0d39027 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.633681] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.633728] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.633936] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.634108] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.634203] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.636643] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.639055] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.639055] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.639055] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.639055] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a55332f-b291-4614-8b34-ee4cd0d39027 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.639055] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.639055] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.639639] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.639916] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.640162] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.641485] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.641485] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.641485] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.641485] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.641485] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0a55332f-b291-4614-8b34-ee4cd0d39027',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.688254] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-347 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.688522] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-347" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.688957] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-347" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.689339] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-347" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.689660] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.690235] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.690235] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.690367] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.690499] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.690760] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 749.690899] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 749.691064] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 749.691287] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 749.691442] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 749.691561] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 749.691713] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 749.717086] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 749.717354] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 749.717556] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 749.717778] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-347" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.718208] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-5307eca7-b464-4b24-ab19-bed82ea4e51f taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.718310] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-5307eca7-b464-4b24-ab19-bed82ea4e51f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.718462] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-5307eca7-b464-4b24-ab19-bed82ea4e51f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.718792] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-5307eca7-b464-4b24-ab19-bed82ea4e51f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.718936] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5307eca7-b464-4b24-ab19-bed82ea4e51f',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.143122] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0a55332f-b291-4614-8b34-ee4cd0d39027: rpc.has_security_group_logging(os_id): False [ 750.174992] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.175185] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.175301] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.175597] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.175652] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.175826] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.175982] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.176093] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.176257] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.176340] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.176572] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.176681] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.176755] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.176977] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.176977] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.178305] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.178443] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.178497] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.178610] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.178788] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.178788] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a55332f-b291-4614-8b34-ee4cd0d39027 is going to be created. [ 750.221765] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.222072] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.222310] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.222614] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.222671] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.222892] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 5307eca7-b464-4b24-ab19-bed82ea4e51f not found, creating... [ 750.223092] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.223265] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.223381] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.223610] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.223897] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.224067] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.224253] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.224373] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.224606] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.224944] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.226240] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 5307eca7-b464-4b24-ab19-bed82ea4e51f is going to be created. [ 750.254112] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.254112] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.254112] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.254112] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.254112] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.254112] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-5307eca7-b464-4b24-ab19-bed82ea4e51f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.267587] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.267722] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.267761] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.267953] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.268153] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.285139] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a55332f-b291-4614-8b34-ee4cd0d39027 in Status: IN_PROGRESS for 2s [ 751.132241] env[70614]: INFO networking_nsxv3.common.synchronization [req-12fac734-5599-4144-a1eb-9b83be555f66 req-04e5386e-ab40-4ee9-b975-eadafa445220 service nova] Enqueued Resource ID: ec4cc5da-964e-43e8-9531-6581ec387b4d with Priority: HIGHEST for action security_group_rules [ 751.132241] env[70614]: INFO networking_nsxv3.common.synchronization [req-12fac734-5599-4144-a1eb-9b83be555f66 req-04e5386e-ab40-4ee9-b975-eadafa445220 service nova] Enqueued Resource ID: ec4cc5da-964e-43e8-9531-6581ec387b4d with Priority: HIGHEST for action security_group_members [ 751.132241] env[70614]: INFO networking_nsxv3.common.synchronization [req-12fac734-5599-4144-a1eb-9b83be555f66 req-04e5386e-ab40-4ee9-b975-eadafa445220 service nova] Enqueued Resource ID: 5307eca7-b464-4b24-ab19-bed82ea4e51f with Priority: HIGHEST for action port [ 751.132542] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec4cc5da-964e-43e8-9531-6581ec387b4d with Priority: HIGHEST for action security_group_rules [ 751.132542] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec4cc5da-964e-43e8-9531-6581ec387b4d with Priority: HIGHEST for action security_group_members [ 751.132615] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5307eca7-b464-4b24-ab19-bed82ea4e51f with Priority: HIGHEST for action port [ 751.133020] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ec4cc5da-964e-43e8-9531-6581ec387b4d taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.133455] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ec4cc5da-964e-43e8-9531-6581ec387b4d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.133623] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ec4cc5da-964e-43e8-9531-6581ec387b4d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.134033] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ec4cc5da-964e-43e8-9531-6581ec387b4d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.134275] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ec4cc5da-964e-43e8-9531-6581ec387b4d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.135283] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec4cc5da-964e-43e8-9531-6581ec387b4d taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.135576] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec4cc5da-964e-43e8-9531-6581ec387b4d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.135751] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec4cc5da-964e-43e8-9531-6581ec387b4d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.136188] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec4cc5da-964e-43e8-9531-6581ec387b4d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.136269] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.136415] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.136567] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.136742] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.136871] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.136997] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec4cc5da-964e-43e8-9531-6581ec387b4d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.137980] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-5307eca7-b464-4b24-ab19-bed82ea4e51f taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.138086] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5307eca7-b464-4b24-ab19-bed82ea4e51f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.138187] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5307eca7-b464-4b24-ab19-bed82ea4e51f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.138405] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5307eca7-b464-4b24-ab19-bed82ea4e51f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.138531] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5307eca7-b464-4b24-ab19-bed82ea4e51f',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.644643] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec4cc5da-964e-43e8-9531-6581ec387b4d taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.644643] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec4cc5da-964e-43e8-9531-6581ec387b4d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.644841] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ec4cc5da-964e-43e8-9531-6581ec387b4d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.645922] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5307eca7-b464-4b24-ab19-bed82ea4e51f with status ACTIVE [ 751.646195] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.646356] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.646447] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.646708] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.646827] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.647102] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.647272] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.647389] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.647535] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.647640] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.647886] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.648069] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.648148] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.648340] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.648459] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.648577] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5307eca7-b464-4b24-ab19-bed82ea4e51f is going to be updated. [ 751.681819] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.682587] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.682733] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.683038] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.683245] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.683917] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5307eca7-b464-4b24-ab19-bed82ea4e51f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.150733] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ec4cc5da-964e-43e8-9531-6581ec387b4d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.298129] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a55332f-b291-4614-8b34-ee4cd0d39027 in Status: SUCCESS [ 752.298331] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.653987] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.654182] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.654266] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.654456] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.654548] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.654647] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec4cc5da-964e-43e8-9531-6581ec387b4d is going to be created. [ 752.686147] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.686418] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.686418] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.687095] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.687095] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.706155] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec4cc5da-964e-43e8-9531-6581ec387b4d in Status: UNINITIALIZED for 2s [ 754.717609] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec4cc5da-964e-43e8-9531-6581ec387b4d in Status: SUCCESS [ 754.717899] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec4cc5da-964e-43e8-9531-6581ec387b4d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.718049] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec4cc5da-964e-43e8-9531-6581ec387b4d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.718358] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec4cc5da-964e-43e8-9531-6581ec387b4d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.718562] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.718744] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.718820] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.718987] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.719098] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.719181] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec4cc5da-964e-43e8-9531-6581ec387b4d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.719731] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ec4cc5da-964e-43e8-9531-6581ec387b4d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.222239] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec4cc5da-964e-43e8-9531-6581ec387b4d taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.222376] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec4cc5da-964e-43e8-9531-6581ec387b4d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.222452] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec4cc5da-964e-43e8-9531-6581ec387b4d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.222672] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec4cc5da-964e-43e8-9531-6581ec387b4d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.222845] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.222971] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.223072] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.223208] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.223324] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.223501] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec4cc5da-964e-43e8-9531-6581ec387b4d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.223897] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec4cc5da-964e-43e8-9531-6581ec387b4d taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.223897] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec4cc5da-964e-43e8-9531-6581ec387b4d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.223897] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec4cc5da-964e-43e8-9531-6581ec387b4d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.223897] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec4cc5da-964e-43e8-9531-6581ec387b4d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.224152] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.224152] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.224152] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.224300] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.224300] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.224396] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec4cc5da-964e-43e8-9531-6581ec387b4d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.224581] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ec4cc5da-964e-43e8-9531-6581ec387b4d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.727132] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ec4cc5da-964e-43e8-9531-6581ec387b4d: rpc.has_security_group_logging(os_id): False [ 755.749113] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.749272] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.749345] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.753174] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.753341] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.753611] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.753776] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.753813] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.754021] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.754075] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.754273] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.754373] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.754434] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.754579] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.754647] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.754821] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.754913] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.754977] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.755119] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.755193] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.755281] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ec4cc5da-964e-43e8-9531-6581ec387b4d is going to be created. [ 755.813522] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.813668] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.813721] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.813941] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.814234] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.831045] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ec4cc5da-964e-43e8-9531-6581ec387b4d in Status: IN_PROGRESS for 2s [ 756.137023] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 756.137023] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 756.762274] env[70614]: INFO networking_nsxv3.common.synchronization [req-ed8577c7-2ba3-41dc-baa9-0fcb3c760ef7 req-6c382063-14ae-44f6-a4f4-734b0e3ca902 tempest-DeleteServersAdminTestJSON-2096477242 tempest-DeleteServersAdminTestJSON-2096477242-project-member] Enqueued Resource ID: 63a56402-3dcf-44d4-b33d-a56ff531a12c with Priority: HIGHEST for action security_group_members [ 756.762926] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63a56402-3dcf-44d4-b33d-a56ff531a12c with Priority: HIGHEST for action security_group_members [ 756.763261] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-63a56402-3dcf-44d4-b33d-a56ff531a12c taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.763378] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63a56402-3dcf-44d4-b33d-a56ff531a12c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.763449] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63a56402-3dcf-44d4-b33d-a56ff531a12c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.763693] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63a56402-3dcf-44d4-b33d-a56ff531a12c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.763881] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.763986] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.765165] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.765502] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.765660] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.765791] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63a56402-3dcf-44d4-b33d-a56ff531a12c',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.269519] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.269677] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.271108] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.271108] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.271108] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.271108] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.271108] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.271108] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.271108] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.271108] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.271108] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63a56402-3dcf-44d4-b33d-a56ff531a12c is going to be updated. [ 757.307482] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.307670] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.309583] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.309583] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.309583] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.319068] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63a56402-3dcf-44d4-b33d-a56ff531a12c in Status: IN_PROGRESS for 2s [ 757.747782] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-573 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.748077] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-573" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.748186] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-573" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.748496] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-573" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.748716] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.748880] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.748996] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.749381] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.749760] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.749760] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 757.749880] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 757.749942] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 757.750059] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 757.750163] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 757.750262] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 757.750387] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 757.776389] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 757.776750] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 757.776750] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 757.776750] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-573" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.777036] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-772ad851-5056-453c-8026-1bb99eec6acb taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.777208] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-772ad851-5056-453c-8026-1bb99eec6acb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.777531] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-772ad851-5056-453c-8026-1bb99eec6acb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.780085] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-772ad851-5056-453c-8026-1bb99eec6acb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.780354] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('772ad851-5056-453c-8026-1bb99eec6acb',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.827391] env[70614]: INFO networking_nsxv3.common.synchronization [req-3b4b926b-0314-408c-b47e-bfa9a94ad92d req-149e9d39-7ea1-4605-8a91-7cf09924631b tempest-AttachInterfacesV270Test-1136727211 tempest-AttachInterfacesV270Test-1136727211-project-member] Enqueued Resource ID: 3177f360-f74b-456a-9c1b-681726056f53 with Priority: HIGHEST for action security_group_members [ 757.827919] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3177f360-f74b-456a-9c1b-681726056f53 with Priority: HIGHEST for action security_group_members [ 757.828240] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-3177f360-f74b-456a-9c1b-681726056f53 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.828368] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3177f360-f74b-456a-9c1b-681726056f53" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.828436] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3177f360-f74b-456a-9c1b-681726056f53" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.828635] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3177f360-f74b-456a-9c1b-681726056f53" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.828787] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.828883] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.828944] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.829194] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.829284] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.829382] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3177f360-f74b-456a-9c1b-681726056f53',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.849358] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ec4cc5da-964e-43e8-9531-6581ec387b4d in Status: SUCCESS [ 757.849630] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ec4cc5da-964e-43e8-9531-6581ec387b4d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.283844] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.284165] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.284220] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.284474] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.284622] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.284776] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 772ad851-5056-453c-8026-1bb99eec6acb not found, creating... [ 758.285972] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.285972] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.285972] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.285972] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.285972] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.285972] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.286328] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.286328] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.286443] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.286571] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.286869] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 772ad851-5056-453c-8026-1bb99eec6acb is going to be created. [ 758.312382] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.312629] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.312753] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.313087] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.313332] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.313588] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-772ad851-5056-453c-8026-1bb99eec6acb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.333699] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.333854] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.333928] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.334159] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.334251] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.334449] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.334548] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.334611] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.334755] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.334831] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.334917] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3177f360-f74b-456a-9c1b-681726056f53 is going to be updated. [ 758.375256] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.375438] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.375671] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.375772] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.375881] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.379539] env[70614]: INFO networking_nsxv3.common.synchronization [req-b22dbf2b-a576-42cf-91e7-bd4358088d97 req-0e330c0f-b5da-4fe9-a382-fc464ccbfac9 tempest-ImagesOneServerNegativeTestJSON-1769697081 tempest-ImagesOneServerNegativeTestJSON-1769697081-project-member] Enqueued Resource ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e with Priority: HIGHEST for action security_group_members [ 758.380515] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e with Priority: HIGHEST for action security_group_members [ 758.380824] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-3060abf5-a0d6-4fce-88da-15f03f632b6e taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.380950] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.380995] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.382600] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.382600] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.382600] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.382600] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.382600] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.382600] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.382600] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3060abf5-a0d6-4fce-88da-15f03f632b6e',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.402665] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3177f360-f74b-456a-9c1b-681726056f53 in Status: IN_PROGRESS for 2s [ 758.886533] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.886806] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.886806] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.886976] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.887134] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.887403] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.887523] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.887575] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.887713] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.887802] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.887927] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e is going to be updated. [ 758.920270] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.920270] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.920270] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.920270] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.920270] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.932225] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e in Status: IN_PROGRESS for 2s [ 759.202815] env[70614]: INFO networking_nsxv3.common.synchronization [req-ed8577c7-2ba3-41dc-baa9-0fcb3c760ef7 req-e4c6bf6f-85cf-44ee-96cb-7c93fba1828c service nova] Enqueued Resource ID: 63a56402-3dcf-44d4-b33d-a56ff531a12c with Priority: HIGHEST for action security_group_rules [ 759.202815] env[70614]: INFO networking_nsxv3.common.synchronization [req-ed8577c7-2ba3-41dc-baa9-0fcb3c760ef7 req-e4c6bf6f-85cf-44ee-96cb-7c93fba1828c service nova] Enqueued Resource ID: 63a56402-3dcf-44d4-b33d-a56ff531a12c with Priority: HIGHEST for action security_group_members [ 759.204192] env[70614]: INFO networking_nsxv3.common.synchronization [req-ed8577c7-2ba3-41dc-baa9-0fcb3c760ef7 req-e4c6bf6f-85cf-44ee-96cb-7c93fba1828c service nova] Enqueued Resource ID: 772ad851-5056-453c-8026-1bb99eec6acb with Priority: HIGHEST for action port [ 759.204565] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63a56402-3dcf-44d4-b33d-a56ff531a12c with Priority: HIGHEST for action security_group_rules [ 759.204707] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63a56402-3dcf-44d4-b33d-a56ff531a12c with Priority: HIGHEST for action security_group_members [ 759.204810] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 772ad851-5056-453c-8026-1bb99eec6acb with Priority: HIGHEST for action port [ 759.206102] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-63a56402-3dcf-44d4-b33d-a56ff531a12c taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.206436] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-63a56402-3dcf-44d4-b33d-a56ff531a12c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.206513] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-63a56402-3dcf-44d4-b33d-a56ff531a12c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.206781] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-63a56402-3dcf-44d4-b33d-a56ff531a12c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.206886] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('63a56402-3dcf-44d4-b33d-a56ff531a12c',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.212964] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-63a56402-3dcf-44d4-b33d-a56ff531a12c taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.212964] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63a56402-3dcf-44d4-b33d-a56ff531a12c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.212964] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-772ad851-5056-453c-8026-1bb99eec6acb taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.212964] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-772ad851-5056-453c-8026-1bb99eec6acb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.212964] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-772ad851-5056-453c-8026-1bb99eec6acb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.212964] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-772ad851-5056-453c-8026-1bb99eec6acb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.212964] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('772ad851-5056-453c-8026-1bb99eec6acb',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.333624] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63a56402-3dcf-44d4-b33d-a56ff531a12c in Status: SUCCESS [ 759.334249] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63a56402-3dcf-44d4-b33d-a56ff531a12c deletion is rescheduled due to dependency. [ 759.334249] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63a56402-3dcf-44d4-b33d-a56ff531a12c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.334249] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63a56402-3dcf-44d4-b33d-a56ff531a12c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.334588] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63a56402-3dcf-44d4-b33d-a56ff531a12c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.335429] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.335429] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.335429] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.335429] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.335429] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.335736] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63a56402-3dcf-44d4-b33d-a56ff531a12c',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.676111] env[70614]: INFO networking_nsxv3.common.synchronization [req-644fcc50-be2d-4a37-8a13-19cefd73b076 req-e3b85b80-1b84-4d0b-a56e-d7b41bdea555 tempest-ServersAdminNegativeTestJSON-1410393069 tempest-ServersAdminNegativeTestJSON-1410393069-project-member] Enqueued Resource ID: e8c65e5a-d52c-481c-a6b2-680dae9a4593 with Priority: HIGHEST for action security_group_members [ 759.676111] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8c65e5a-d52c-481c-a6b2-680dae9a4593 with Priority: HIGHEST for action security_group_members [ 759.676913] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8c65e5a-d52c-481c-a6b2-680dae9a4593 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.676994] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8c65e5a-d52c-481c-a6b2-680dae9a4593" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.677092] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8c65e5a-d52c-481c-a6b2-680dae9a4593" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.677374] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8c65e5a-d52c-481c-a6b2-680dae9a4593" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.678381] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.678627] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.678627] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.679020] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.679020] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.679020] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e8c65e5a-d52c-481c-a6b2-680dae9a4593',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.712764] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-63a56402-3dcf-44d4-b33d-a56ff531a12c taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.712893] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63a56402-3dcf-44d4-b33d-a56ff531a12c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.714572] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 772ad851-5056-453c-8026-1bb99eec6acb with status ACTIVE [ 759.714777] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.716858] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.717013] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.717263] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.717440] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.717655] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.717768] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.717840] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.718019] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.718096] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.718308] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.718406] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.718467] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.718605] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.718680] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.718764] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 772ad851-5056-453c-8026-1bb99eec6acb is going to be updated. [ 759.742154] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.742154] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.742154] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.742154] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.742154] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.742399] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-772ad851-5056-453c-8026-1bb99eec6acb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.841672] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('63a56402-3dcf-44d4-b33d-a56ff531a12c',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.067976] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-573 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.068349] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-573" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.068511] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-573" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.068784] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-573" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.069075] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.069247] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.069348] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.069556] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.069699] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.069937] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 760.070513] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 760.070513] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 760.070513] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 760.070513] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 760.070513] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 760.070839] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 760.090621] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 760.090621] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 760.090621] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 760.090621] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-573" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.090834] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-bff28502-31f3-4fc2-890a-e429618480bb taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.091049] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-bff28502-31f3-4fc2-890a-e429618480bb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.091114] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-bff28502-31f3-4fc2-890a-e429618480bb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.091395] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-bff28502-31f3-4fc2-890a-e429618480bb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.091534] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bff28502-31f3-4fc2-890a-e429618480bb',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.183433] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.183433] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.183433] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.183433] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.183433] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.183433] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.183433] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.183433] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.183433] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.183433] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.183433] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8c65e5a-d52c-481c-a6b2-680dae9a4593 already deleted. [ 760.183433] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8c65e5a-d52c-481c-a6b2-680dae9a4593" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.344167] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('63a56402-3dcf-44d4-b33d-a56ff531a12c',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.413989] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3177f360-f74b-456a-9c1b-681726056f53 in Status: SUCCESS [ 760.414199] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3177f360-f74b-456a-9c1b-681726056f53 deletion is rescheduled due to dependency. [ 760.414315] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3177f360-f74b-456a-9c1b-681726056f53" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.596570] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.596875] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.596995] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.597224] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.597401] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.597566] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port bff28502-31f3-4fc2-890a-e429618480bb not found, creating... [ 760.597839] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.597995] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.598125] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.598345] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.598484] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.598761] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.598914] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.599425] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.599702] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.599864] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.600026] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: bff28502-31f3-4fc2-890a-e429618480bb is going to be created. [ 760.619691] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.619911] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.620047] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.620311] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.620537] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.620758] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-bff28502-31f3-4fc2-890a-e429618480bb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.848992] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.848992] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.848992] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.848992] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.848992] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.848992] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63a56402-3dcf-44d4-b33d-a56ff531a12c is going to be updated. [ 760.876704] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.878712] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.878712] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.878712] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.878712] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.886955] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63a56402-3dcf-44d4-b33d-a56ff531a12c in Status: IN_PROGRESS for 2s [ 760.943388] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e in Status: SUCCESS [ 760.944287] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e deletion is rescheduled due to dependency. [ 760.944619] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.736216] env[70614]: INFO networking_nsxv3.common.synchronization [req-644fcc50-be2d-4a37-8a13-19cefd73b076 req-f5697c48-4bff-4d0c-ba17-3d7743654074 service nova] Enqueued Resource ID: e8c65e5a-d52c-481c-a6b2-680dae9a4593 with Priority: HIGHEST for action security_group_rules [ 761.736216] env[70614]: INFO networking_nsxv3.common.synchronization [req-644fcc50-be2d-4a37-8a13-19cefd73b076 req-f5697c48-4bff-4d0c-ba17-3d7743654074 service nova] Enqueued Resource ID: e8c65e5a-d52c-481c-a6b2-680dae9a4593 with Priority: HIGHEST for action security_group_members [ 761.736216] env[70614]: INFO networking_nsxv3.common.synchronization [req-644fcc50-be2d-4a37-8a13-19cefd73b076 req-f5697c48-4bff-4d0c-ba17-3d7743654074 service nova] Enqueued Resource ID: bff28502-31f3-4fc2-890a-e429618480bb with Priority: HIGHEST for action port [ 761.739063] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8c65e5a-d52c-481c-a6b2-680dae9a4593 with Priority: HIGHEST for action security_group_rules [ 761.739341] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8c65e5a-d52c-481c-a6b2-680dae9a4593 with Priority: HIGHEST for action security_group_members [ 761.739594] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bff28502-31f3-4fc2-890a-e429618480bb with Priority: HIGHEST for action port [ 761.740633] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e8c65e5a-d52c-481c-a6b2-680dae9a4593 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.740788] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e8c65e5a-d52c-481c-a6b2-680dae9a4593" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.740861] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e8c65e5a-d52c-481c-a6b2-680dae9a4593" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.741166] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e8c65e5a-d52c-481c-a6b2-680dae9a4593" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.741313] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e8c65e5a-d52c-481c-a6b2-680dae9a4593',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.743831] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8c65e5a-d52c-481c-a6b2-680dae9a4593 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.743971] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8c65e5a-d52c-481c-a6b2-680dae9a4593" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.744161] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8c65e5a-d52c-481c-a6b2-680dae9a4593" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.744326] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8c65e5a-d52c-481c-a6b2-680dae9a4593" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.744492] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.744596] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.744745] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.749132] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.749410] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.749598] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e8c65e5a-d52c-481c-a6b2-680dae9a4593',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.750967] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-bff28502-31f3-4fc2-890a-e429618480bb taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.751191] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bff28502-31f3-4fc2-890a-e429618480bb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.751306] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bff28502-31f3-4fc2-890a-e429618480bb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.751650] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bff28502-31f3-4fc2-890a-e429618480bb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.751686] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bff28502-31f3-4fc2-890a-e429618480bb',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.254419] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e8c65e5a-d52c-481c-a6b2-680dae9a4593',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.256682] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8c65e5a-d52c-481c-a6b2-680dae9a4593 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.256824] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8c65e5a-d52c-481c-a6b2-680dae9a4593" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.257531] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bff28502-31f3-4fc2-890a-e429618480bb with status ACTIVE [ 762.257531] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.257531] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.257531] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.257531] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.257746] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.257776] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.258656] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.258656] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.258656] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.258656] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.258656] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.258656] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.258656] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.258656] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.258927] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.258927] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bff28502-31f3-4fc2-890a-e429618480bb is going to be updated. [ 762.284457] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.284620] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.284695] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.284906] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.285060] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.285217] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bff28502-31f3-4fc2-890a-e429618480bb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.295742] env[70614]: INFO networking_nsxv3.common.synchronization [req-e2510f03-53f4-41c3-b148-ab5a445a31cb req-6afd9ddf-2ab6-4937-9129-abb1f759a325 tempest-DeleteServersTestJSON-1690139659 tempest-DeleteServersTestJSON-1690139659-project-member] Enqueued Resource ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f with Priority: HIGHEST for action security_group_members [ 762.299171] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f with Priority: HIGHEST for action security_group_members [ 762.299171] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.299171] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.299171] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.299171] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.299171] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.299171] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.299171] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.299171] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.299171] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.299171] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df8f20f5-6e92-4ac4-bdd2-05863ac4905f',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.717862] env[70614]: INFO networking_nsxv3.common.synchronization [None req-55169169-e8e7-48c5-a133-ee8138c0325e None None] Enqueued Resource ID: 7f543dde-2c9d-426b-b78a-37791d320a6d with Priority: HIGHEST for action port [ 762.719398] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f543dde-2c9d-426b-b78a-37791d320a6d with Priority: HIGHEST for action port [ 762.719398] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-7f543dde-2c9d-426b-b78a-37791d320a6d taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.719398] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7f543dde-2c9d-426b-b78a-37791d320a6d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.719398] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7f543dde-2c9d-426b-b78a-37791d320a6d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.719710] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7f543dde-2c9d-426b-b78a-37791d320a6d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.719818] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f543dde-2c9d-426b-b78a-37791d320a6d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.757897] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e8c65e5a-d52c-481c-a6b2-680dae9a4593',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.804031] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.804031] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.804031] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.804031] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.804031] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.804031] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.804031] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.804031] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.804031] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.804031] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.804031] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f is going to be updated. [ 762.816027] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-707 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.816027] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-707" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.816027] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-707" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.816793] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-707" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.817260] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.819992] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.819992] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.819992] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.819992] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.819992] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 762.819992] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 762.819992] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 762.819992] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 762.819992] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 762.819992] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 762.819992] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 762.846579] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 762.846752] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 762.846887] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 762.847090] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-707" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.847587] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-4ae9fe33-cda7-4614-b8bd-1699b68a3014 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.847756] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-4ae9fe33-cda7-4614-b8bd-1699b68a3014" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.847756] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-4ae9fe33-cda7-4614-b8bd-1699b68a3014" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.848112] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-4ae9fe33-cda7-4614-b8bd-1699b68a3014" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.848257] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ae9fe33-cda7-4614-b8bd-1699b68a3014',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.850314] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.851083] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.851083] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.851083] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.851083] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.864328] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f in Status: IN_PROGRESS for 2s [ 762.902509] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63a56402-3dcf-44d4-b33d-a56ff531a12c in Status: SUCCESS [ 762.902872] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63a56402-3dcf-44d4-b33d-a56ff531a12c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.903074] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63a56402-3dcf-44d4-b33d-a56ff531a12c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.903305] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63a56402-3dcf-44d4-b33d-a56ff531a12c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.903520] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.903665] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.903720] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.903897] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.908770] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.908770] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63a56402-3dcf-44d4-b33d-a56ff531a12c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.908770] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('63a56402-3dcf-44d4-b33d-a56ff531a12c',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.162732] env[70614]: INFO networking_nsxv3.common.synchronization [req-0cfcf6c5-a782-42b7-9ee4-827a3c36814a req-73f6cb68-328b-4a70-880e-ec1386f6fe3e tempest-InstanceActionsV221TestJSON-747316391 tempest-InstanceActionsV221TestJSON-747316391-project-member] Enqueued Resource ID: ec4cc5da-964e-43e8-9531-6581ec387b4d with Priority: HIGHEST for action security_group_members [ 763.163341] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec4cc5da-964e-43e8-9531-6581ec387b4d with Priority: HIGHEST for action security_group_members [ 763.163615] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec4cc5da-964e-43e8-9531-6581ec387b4d taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.163843] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec4cc5da-964e-43e8-9531-6581ec387b4d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.163843] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec4cc5da-964e-43e8-9531-6581ec387b4d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.166215] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec4cc5da-964e-43e8-9531-6581ec387b4d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.166215] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.166215] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.166215] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.166215] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.166215] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.166215] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec4cc5da-964e-43e8-9531-6581ec387b4d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.221957] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7f543dde-2c9d-426b-b78a-37791d320a6d [ 763.222204] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.222353] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.222421] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.222637] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.222748] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.222859] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7f543dde-2c9d-426b-b78a-37791d320a6d already deleted. [ 763.222946] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7f543dde-2c9d-426b-b78a-37791d320a6d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.264929] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.264929] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.264929] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.265264] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.265264] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.265264] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8c65e5a-d52c-481c-a6b2-680dae9a4593 is going to be created. [ 763.300509] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.300509] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.300509] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.300509] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.300509] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.312071] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8c65e5a-d52c-481c-a6b2-680dae9a4593 in Status: UNINITIALIZED for 2s [ 763.354726] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.354968] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.355881] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.356220] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.356376] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.356550] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 4ae9fe33-cda7-4614-b8bd-1699b68a3014 not found, creating... [ 763.356829] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.357264] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.357479] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.357744] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.357885] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.358233] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.358416] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.358551] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.358782] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.358960] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.360186] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 4ae9fe33-cda7-4614-b8bd-1699b68a3014 is going to be created. [ 763.384158] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.384436] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.384602] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.384921] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.385220] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.385510] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-4ae9fe33-cda7-4614-b8bd-1699b68a3014" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.412135] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-63a56402-3dcf-44d4-b33d-a56ff531a12c taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.412318] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63a56402-3dcf-44d4-b33d-a56ff531a12c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.412377] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63a56402-3dcf-44d4-b33d-a56ff531a12c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.416040] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63a56402-3dcf-44d4-b33d-a56ff531a12c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.416040] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.416040] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.416040] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.416040] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.416040] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.416040] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63a56402-3dcf-44d4-b33d-a56ff531a12c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.416040] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-63a56402-3dcf-44d4-b33d-a56ff531a12c taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.416040] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63a56402-3dcf-44d4-b33d-a56ff531a12c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.416040] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63a56402-3dcf-44d4-b33d-a56ff531a12c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.416040] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63a56402-3dcf-44d4-b33d-a56ff531a12c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.416040] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.416040] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.416040] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.416040] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.416040] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.417144] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63a56402-3dcf-44d4-b33d-a56ff531a12c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.417144] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('63a56402-3dcf-44d4-b33d-a56ff531a12c',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.670830] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.670830] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.670830] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.670830] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.670830] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.670830] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.670830] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.670830] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.670830] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.670830] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.670830] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec4cc5da-964e-43e8-9531-6581ec387b4d is going to be updated. [ 763.701188] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.701188] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.701306] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.701500] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.701614] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.712441] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec4cc5da-964e-43e8-9531-6581ec387b4d in Status: IN_PROGRESS for 2s [ 763.921047] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 63a56402-3dcf-44d4-b33d-a56ff531a12c: rpc.has_security_group_logging(os_id): False [ 763.941320] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.941535] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.941535] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.941733] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.941818] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.942038] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.942135] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.942197] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.942363] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.942440] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.942618] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.942739] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.942788] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.942924] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.942993] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.943209] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.943269] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.943325] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.943459] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.943529] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.943609] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 63a56402-3dcf-44d4-b33d-a56ff531a12c is going to be updated. [ 764.021733] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.021905] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.022067] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.022312] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.022430] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.037867] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63a56402-3dcf-44d4-b33d-a56ff531a12c in Status: IN_PROGRESS for 2s [ 764.227130] env[70614]: INFO networking_nsxv3.common.synchronization [req-e2510f03-53f4-41c3-b148-ab5a445a31cb req-532c5a3c-5f82-4b0c-8d40-4f4d906d5af9 service nova] Enqueued Resource ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f with Priority: HIGHEST for action security_group_rules [ 764.227226] env[70614]: INFO networking_nsxv3.common.synchronization [req-e2510f03-53f4-41c3-b148-ab5a445a31cb req-532c5a3c-5f82-4b0c-8d40-4f4d906d5af9 service nova] Enqueued Resource ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f with Priority: HIGHEST for action security_group_members [ 764.227402] env[70614]: INFO networking_nsxv3.common.synchronization [req-e2510f03-53f4-41c3-b148-ab5a445a31cb req-532c5a3c-5f82-4b0c-8d40-4f4d906d5af9 service nova] Enqueued Resource ID: 4ae9fe33-cda7-4614-b8bd-1699b68a3014 with Priority: HIGHEST for action port [ 764.227662] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f with Priority: HIGHEST for action security_group_rules [ 764.227796] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f with Priority: HIGHEST for action security_group_members [ 764.227905] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ae9fe33-cda7-4614-b8bd-1699b68a3014 with Priority: HIGHEST for action port [ 764.228618] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df8f20f5-6e92-4ac4-bdd2-05863ac4905f taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.228761] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.228855] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.229065] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.229152] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df8f20f5-6e92-4ac4-bdd2-05863ac4905f',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.231563] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.231563] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.231920] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-4ae9fe33-cda7-4614-b8bd-1699b68a3014 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.232119] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4ae9fe33-cda7-4614-b8bd-1699b68a3014" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.232217] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4ae9fe33-cda7-4614-b8bd-1699b68a3014" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.232470] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4ae9fe33-cda7-4614-b8bd-1699b68a3014" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.232602] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ae9fe33-cda7-4614-b8bd-1699b68a3014',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.738019] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.738019] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.738019] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4ae9fe33-cda7-4614-b8bd-1699b68a3014 with status ACTIVE [ 764.738019] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.738019] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.738019] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.738019] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.738019] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.738019] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.738019] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.738019] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.738019] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.738019] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.738019] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.738543] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.738543] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.738543] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.738543] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.738543] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4ae9fe33-cda7-4614-b8bd-1699b68a3014 is going to be updated. [ 764.762215] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.762215] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.762215] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.762215] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.762215] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.762215] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4ae9fe33-cda7-4614-b8bd-1699b68a3014" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.879667] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f in Status: SUCCESS [ 764.883164] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f deletion is rescheduled due to dependency. [ 764.883164] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.883164] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.883164] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.883164] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.883164] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.883164] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.883164] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.883164] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.883164] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df8f20f5-6e92-4ac4-bdd2-05863ac4905f',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.151595] env[70614]: INFO networking_nsxv3.common.synchronization [None req-5364231c-3e10-477d-8c05-24090c10c40f None None] Enqueued Resource ID: 1a814ed0-3907-42c8-b38b-2cbe159d9ef2 with Priority: HIGHEST for action port [ 765.152258] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a814ed0-3907-42c8-b38b-2cbe159d9ef2 with Priority: HIGHEST for action port [ 765.155817] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a814ed0-3907-42c8-b38b-2cbe159d9ef2 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.155817] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a814ed0-3907-42c8-b38b-2cbe159d9ef2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.155817] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a814ed0-3907-42c8-b38b-2cbe159d9ef2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.155817] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a814ed0-3907-42c8-b38b-2cbe159d9ef2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.155817] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a814ed0-3907-42c8-b38b-2cbe159d9ef2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.328565] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8c65e5a-d52c-481c-a6b2-680dae9a4593 in Status: SUCCESS [ 765.329261] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8c65e5a-d52c-481c-a6b2-680dae9a4593" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.329261] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8c65e5a-d52c-481c-a6b2-680dae9a4593" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.329261] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8c65e5a-d52c-481c-a6b2-680dae9a4593" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.329470] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.329555] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.329605] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.330170] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.330170] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.330170] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8c65e5a-d52c-481c-a6b2-680dae9a4593" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.330170] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e8c65e5a-d52c-481c-a6b2-680dae9a4593',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.387399] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('df8f20f5-6e92-4ac4-bdd2-05863ac4905f',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.660960] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1a814ed0-3907-42c8-b38b-2cbe159d9ef2 [ 765.660960] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.660960] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.660960] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.660960] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.660960] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.660960] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1a814ed0-3907-42c8-b38b-2cbe159d9ef2 already deleted. [ 765.660960] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a814ed0-3907-42c8-b38b-2cbe159d9ef2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.726215] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec4cc5da-964e-43e8-9531-6581ec387b4d in Status: SUCCESS [ 765.726772] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec4cc5da-964e-43e8-9531-6581ec387b4d deletion is rescheduled due to dependency. [ 765.727532] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec4cc5da-964e-43e8-9531-6581ec387b4d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.835055] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8c65e5a-d52c-481c-a6b2-680dae9a4593 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.835055] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8c65e5a-d52c-481c-a6b2-680dae9a4593" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.835258] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8c65e5a-d52c-481c-a6b2-680dae9a4593" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.835751] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8c65e5a-d52c-481c-a6b2-680dae9a4593" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.835751] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.835751] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.835751] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.835912] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.836069] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.836144] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8c65e5a-d52c-481c-a6b2-680dae9a4593" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.837079] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8c65e5a-d52c-481c-a6b2-680dae9a4593 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.837079] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8c65e5a-d52c-481c-a6b2-680dae9a4593" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.837079] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8c65e5a-d52c-481c-a6b2-680dae9a4593" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.837079] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8c65e5a-d52c-481c-a6b2-680dae9a4593" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.837079] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.837079] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.837079] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.837079] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.837609] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.837609] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8c65e5a-d52c-481c-a6b2-680dae9a4593" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.837609] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e8c65e5a-d52c-481c-a6b2-680dae9a4593',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.890699] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('df8f20f5-6e92-4ac4-bdd2-05863ac4905f',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.061463] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63a56402-3dcf-44d4-b33d-a56ff531a12c in Status: SUCCESS [ 766.061463] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-63a56402-3dcf-44d4-b33d-a56ff531a12c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.340530] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e8c65e5a-d52c-481c-a6b2-680dae9a4593: rpc.has_security_group_logging(os_id): False [ 766.363069] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.363069] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.363069] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.364315] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.364315] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.365237] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.368160] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.368160] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.368160] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.368160] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.368160] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.368160] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.368160] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.368160] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.368160] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.368160] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.368160] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.368160] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.368160] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.368160] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.368160] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e8c65e5a-d52c-481c-a6b2-680dae9a4593 is going to be created. [ 766.398270] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.398270] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.398270] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.398270] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.398270] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.398270] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f is going to be updated. [ 766.447398] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.447614] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.447719] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.447969] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.448159] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.461303] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.461588] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.461588] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.461789] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.462095] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.469631] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f in Status: IN_PROGRESS for 2s [ 766.476426] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e8c65e5a-d52c-481c-a6b2-680dae9a4593 in Status: IN_PROGRESS for 2s [ 768.485008] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f in Status: SUCCESS [ 768.485311] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.485526] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.485872] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.486137] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.486273] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.486347] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.486625] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.487022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.487022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.487124] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('df8f20f5-6e92-4ac4-bdd2-05863ac4905f',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.489551] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e8c65e5a-d52c-481c-a6b2-680dae9a4593 in Status: SUCCESS [ 768.489778] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e8c65e5a-d52c-481c-a6b2-680dae9a4593" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.990871] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.991099] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.991170] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.991393] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.991567] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.991670] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.991733] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.991876] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.991974] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.992087] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.992234] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.992326] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.992387] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.992540] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.992674] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.992765] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.992826] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.992977] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.993063] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.993143] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.993244] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('df8f20f5-6e92-4ac4-bdd2-05863ac4905f',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.499194] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for df8f20f5-6e92-4ac4-bdd2-05863ac4905f: rpc.has_security_group_logging(os_id): False [ 769.529035] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.529035] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.529035] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.529035] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.529035] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.529035] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.529035] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.529035] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.529035] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.529035] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.529035] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.529035] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.529035] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.529035] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.529035] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.529745] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.529745] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.529745] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.529745] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.529745] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.529745] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f is going to be updated. [ 769.613280] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.613280] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.613280] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.613504] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.613675] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.627216] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f in Status: IN_PROGRESS for 2s [ 770.153289] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 770.153417] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 771.250221] env[70614]: INFO networking_nsxv3.common.synchronization [None req-93c727d4-8ac2-4563-a3b7-c475987b23c0 None None] Enqueued Resource ID: 085719fd-5cd9-4cf7-9443-0c4b3e182537 with Priority: HIGHEST for action port [ 771.252373] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 085719fd-5cd9-4cf7-9443-0c4b3e182537 with Priority: HIGHEST for action port [ 771.252744] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-085719fd-5cd9-4cf7-9443-0c4b3e182537 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.252864] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-085719fd-5cd9-4cf7-9443-0c4b3e182537" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.252938] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-085719fd-5cd9-4cf7-9443-0c4b3e182537" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.253213] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-085719fd-5cd9-4cf7-9443-0c4b3e182537" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.253349] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('085719fd-5cd9-4cf7-9443-0c4b3e182537',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.643060] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f in Status: SUCCESS [ 771.643286] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.760558] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 085719fd-5cd9-4cf7-9443-0c4b3e182537 [ 771.760813] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.760947] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.762872] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.762872] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.762872] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.762872] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:085719fd-5cd9-4cf7-9443-0c4b3e182537 already deleted. [ 771.762872] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-085719fd-5cd9-4cf7-9443-0c4b3e182537" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.773867] env[70614]: INFO networking_nsxv3.common.synchronization [req-744180f1-fdbf-4c1c-b5c4-0f186430bfae req-52968fd3-e4db-4a31-8a9c-aeb7e1476fa0 tempest-FloatingIPsAssociationTestJSON-514222769 tempest-FloatingIPsAssociationTestJSON-514222769-project-member] Enqueued Resource ID: f0060547-03fb-4d1a-ad8e-69519760b908 with Priority: HIGHEST for action security_group_members [ 771.775260] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0060547-03fb-4d1a-ad8e-69519760b908 with Priority: HIGHEST for action security_group_members [ 771.775260] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0060547-03fb-4d1a-ad8e-69519760b908 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.775260] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0060547-03fb-4d1a-ad8e-69519760b908" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.775735] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0060547-03fb-4d1a-ad8e-69519760b908" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.775982] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0060547-03fb-4d1a-ad8e-69519760b908" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.776245] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.776307] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.776373] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.776476] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.776592] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.777423] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0060547-03fb-4d1a-ad8e-69519760b908',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.279082] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.279393] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.279393] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.279531] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.279636] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.279967] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.280089] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.280149] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.280307] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.280380] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.281102] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0060547-03fb-4d1a-ad8e-69519760b908 is going to be updated. [ 772.333760] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.333760] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.333935] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.334043] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.334215] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.347156] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0060547-03fb-4d1a-ad8e-69519760b908 in Status: IN_PROGRESS for 2s [ 772.413716] env[70614]: INFO networking_nsxv3.common.synchronization [req-4a04c058-2dce-4c90-b5ce-79542ebbfba5 req-74ecf696-5908-4af0-aee4-309c27d341b4 tempest-DeleteServersAdminTestJSON-2096477242 tempest-DeleteServersAdminTestJSON-2096477242-project-member] Enqueued Resource ID: 63a56402-3dcf-44d4-b33d-a56ff531a12c with Priority: HIGHEST for action security_group_members [ 772.413716] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63a56402-3dcf-44d4-b33d-a56ff531a12c with Priority: HIGHEST for action security_group_members [ 772.413716] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-63a56402-3dcf-44d4-b33d-a56ff531a12c taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.413716] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63a56402-3dcf-44d4-b33d-a56ff531a12c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.413716] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63a56402-3dcf-44d4-b33d-a56ff531a12c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.413716] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63a56402-3dcf-44d4-b33d-a56ff531a12c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.413716] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.413716] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.413716] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.413716] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.413716] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.413716] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63a56402-3dcf-44d4-b33d-a56ff531a12c',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.423364] env[70614]: INFO networking_nsxv3.common.synchronization [req-e39c963f-2eec-4e6d-ae31-a475d6f4496e req-87b4c9d7-930b-4925-89b1-56c9b6543875 tempest-VolumesAssistedSnapshotsTest-988298436 tempest-VolumesAssistedSnapshotsTest-988298436-project-member] Enqueued Resource ID: e8c9194b-5e05-4207-a5ab-784203682b19 with Priority: HIGHEST for action security_group_members [ 772.425078] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8c9194b-5e05-4207-a5ab-784203682b19 with Priority: HIGHEST for action security_group_members [ 772.425078] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8c9194b-5e05-4207-a5ab-784203682b19 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.425078] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8c9194b-5e05-4207-a5ab-784203682b19" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.425078] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8c9194b-5e05-4207-a5ab-784203682b19" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.425078] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8c9194b-5e05-4207-a5ab-784203682b19" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.425078] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.425078] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.425078] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.425426] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.425426] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.425426] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e8c9194b-5e05-4207-a5ab-784203682b19',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.923451] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.923620] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.923706] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.923916] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.924026] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.924232] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.924313] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.924409] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.924537] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.924573] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.924695] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63a56402-3dcf-44d4-b33d-a56ff531a12c is going to be updated. [ 772.928327] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.928327] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.928327] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.928327] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.928327] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.928700] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.928700] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.928700] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.928836] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.928911] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.928999] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8c9194b-5e05-4207-a5ab-784203682b19 is going to be updated. [ 772.943444] env[70614]: INFO networking_nsxv3.common.synchronization [None req-e6f62c07-1a06-4f55-8461-f4078397334e tempest-MigrationsAdminTest-2080415140 tempest-MigrationsAdminTest-2080415140-project-member] Enqueued Resource ID: 71127856-2e5a-4199-963b-b02b58435402 with Priority: HIGHEST for action security_group_rules [ 772.944185] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71127856-2e5a-4199-963b-b02b58435402 with Priority: HIGHEST for action security_group_rules [ 772.945262] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-71127856-2e5a-4199-963b-b02b58435402 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.945262] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-71127856-2e5a-4199-963b-b02b58435402" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.945403] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-71127856-2e5a-4199-963b-b02b58435402" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.945551] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-71127856-2e5a-4199-963b-b02b58435402" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.945631] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('71127856-2e5a-4199-963b-b02b58435402',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.958883] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.959040] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.959111] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.959316] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.959467] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.962028] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.962162] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.962233] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.962442] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.962574] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.974226] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8c9194b-5e05-4207-a5ab-784203682b19 in Status: IN_PROGRESS for 2s [ 772.974957] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63a56402-3dcf-44d4-b33d-a56ff531a12c in Status: IN_PROGRESS for 2s [ 773.104295] env[70614]: INFO networking_nsxv3.common.synchronization [None req-485995ab-9a2c-4020-bece-cf0cfb18e2c5 tempest-MigrationsAdminTest-2080415140 tempest-MigrationsAdminTest-2080415140-project-member] Enqueued Resource ID: 71127856-2e5a-4199-963b-b02b58435402 with Priority: HIGHEST for action security_group_rules [ 773.105032] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71127856-2e5a-4199-963b-b02b58435402 with Priority: HIGHEST for action security_group_rules [ 773.106037] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-71127856-2e5a-4199-963b-b02b58435402 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.106037] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-71127856-2e5a-4199-963b-b02b58435402" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.474264] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.474572] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.474572] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.474713] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.474812] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.474959] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 71127856-2e5a-4199-963b-b02b58435402 already deleted. [ 773.475021] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-71127856-2e5a-4199-963b-b02b58435402" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.475158] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-71127856-2e5a-4199-963b-b02b58435402" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.475330] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-71127856-2e5a-4199-963b-b02b58435402" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.475427] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('71127856-2e5a-4199-963b-b02b58435402',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.991761] env[70614]: INFO networking_nsxv3.common.synchronization [None req-ec504001-82db-4fbf-9579-c72137528ea5 None None] Enqueued Resource ID: 1bf1563c-3201-4f91-acb1-e4855c831927 with Priority: HIGHEST for action port [ 773.992133] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bf1563c-3201-4f91-acb1-e4855c831927 with Priority: HIGHEST for action port [ 773.992677] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-1bf1563c-3201-4f91-acb1-e4855c831927 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.992805] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1bf1563c-3201-4f91-acb1-e4855c831927" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.992872] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1bf1563c-3201-4f91-acb1-e4855c831927" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.993212] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1bf1563c-3201-4f91-acb1-e4855c831927" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.993316] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1bf1563c-3201-4f91-acb1-e4855c831927',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.000941] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.001108] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.001162] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.001376] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.001460] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.001563] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 71127856-2e5a-4199-963b-b02b58435402 already deleted. [ 774.001640] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-71127856-2e5a-4199-963b-b02b58435402" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.357643] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0060547-03fb-4d1a-ad8e-69519760b908 in Status: SUCCESS [ 774.357843] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0060547-03fb-4d1a-ad8e-69519760b908 deletion is rescheduled due to dependency. [ 774.357961] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0060547-03fb-4d1a-ad8e-69519760b908" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.503362] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1bf1563c-3201-4f91-acb1-e4855c831927 [ 774.503638] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.503735] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.503815] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.504021] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.504113] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.504261] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1bf1563c-3201-4f91-acb1-e4855c831927 already deleted. [ 774.504315] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1bf1563c-3201-4f91-acb1-e4855c831927" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.985551] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63a56402-3dcf-44d4-b33d-a56ff531a12c in Status: SUCCESS [ 774.985756] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63a56402-3dcf-44d4-b33d-a56ff531a12c deletion is rescheduled due to dependency. [ 774.985873] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63a56402-3dcf-44d4-b33d-a56ff531a12c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.986612] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8c9194b-5e05-4207-a5ab-784203682b19 in Status: SUCCESS [ 774.986761] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8c9194b-5e05-4207-a5ab-784203682b19 deletion is rescheduled due to dependency. [ 774.986872] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8c9194b-5e05-4207-a5ab-784203682b19" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.744032] env[70614]: INFO networking_nsxv3.common.synchronization [req-6a7a38df-c9cc-43cf-8bbc-599dc50fd991 req-05fb7b8e-8728-4cd6-8810-8cbdbfd3862c tempest-ServersTestManualDisk-62724510 tempest-ServersTestManualDisk-62724510-project-member] Enqueued Resource ID: 336e562f-9c8e-4021-953e-5756518b10b0 with Priority: HIGHEST for action security_group_members [ 777.747022] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 336e562f-9c8e-4021-953e-5756518b10b0 with Priority: HIGHEST for action security_group_members [ 777.747223] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-336e562f-9c8e-4021-953e-5756518b10b0 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.747351] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-336e562f-9c8e-4021-953e-5756518b10b0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.747419] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-336e562f-9c8e-4021-953e-5756518b10b0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.747713] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-336e562f-9c8e-4021-953e-5756518b10b0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.747870] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.747974] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.748049] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.748204] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.748296] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.748395] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('336e562f-9c8e-4021-953e-5756518b10b0',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.122059] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-274 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.122059] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-274" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.122059] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-274" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.122059] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-274" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.122059] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.122059] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.122059] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.122059] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.122059] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.122485] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 778.122485] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 778.122485] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 778.122599] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 778.122653] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 778.122729] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 778.123312] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 778.144932] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 778.145149] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 778.145287] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 778.145486] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-274" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.145777] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-1d540e4b-e19a-4292-9e4b-3a000417f3f6 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.145945] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-1d540e4b-e19a-4292-9e4b-3a000417f3f6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.146079] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-1d540e4b-e19a-4292-9e4b-3a000417f3f6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.146459] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-1d540e4b-e19a-4292-9e4b-3a000417f3f6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.146548] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d540e4b-e19a-4292-9e4b-3a000417f3f6',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.251601] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.251724] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.251764] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.252018] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.252126] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.252328] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.252432] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.252495] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.252654] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.253252] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.253252] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 336e562f-9c8e-4021-953e-5756518b10b0 already deleted. [ 778.253252] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-336e562f-9c8e-4021-953e-5756518b10b0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.649622] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.649857] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.649986] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.650365] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.650523] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.650688] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 1d540e4b-e19a-4292-9e4b-3a000417f3f6 not found, creating... [ 778.650956] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.651756] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.651887] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.652154] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.653382] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.653382] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.653382] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.653382] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.653669] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.653736] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.653891] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 1d540e4b-e19a-4292-9e4b-3a000417f3f6 is going to be created. [ 778.674459] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.674716] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.674881] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.675215] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.675589] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.675939] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-1d540e4b-e19a-4292-9e4b-3a000417f3f6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.426956] env[70614]: INFO networking_nsxv3.common.synchronization [req-6a7a38df-c9cc-43cf-8bbc-599dc50fd991 req-ecf90595-9053-47ec-83be-f40e4d772a67 service nova] Enqueued Resource ID: 336e562f-9c8e-4021-953e-5756518b10b0 with Priority: HIGHEST for action security_group_rules [ 779.426956] env[70614]: INFO networking_nsxv3.common.synchronization [req-6a7a38df-c9cc-43cf-8bbc-599dc50fd991 req-ecf90595-9053-47ec-83be-f40e4d772a67 service nova] Enqueued Resource ID: 336e562f-9c8e-4021-953e-5756518b10b0 with Priority: HIGHEST for action security_group_members [ 779.426956] env[70614]: INFO networking_nsxv3.common.synchronization [req-6a7a38df-c9cc-43cf-8bbc-599dc50fd991 req-ecf90595-9053-47ec-83be-f40e4d772a67 service nova] Enqueued Resource ID: 1d540e4b-e19a-4292-9e4b-3a000417f3f6 with Priority: HIGHEST for action port [ 779.426956] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 336e562f-9c8e-4021-953e-5756518b10b0 with Priority: HIGHEST for action security_group_rules [ 779.427434] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 336e562f-9c8e-4021-953e-5756518b10b0 with Priority: HIGHEST for action security_group_members [ 779.427434] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d540e4b-e19a-4292-9e4b-3a000417f3f6 with Priority: HIGHEST for action port [ 779.428265] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-336e562f-9c8e-4021-953e-5756518b10b0 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.428265] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-336e562f-9c8e-4021-953e-5756518b10b0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.428265] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-336e562f-9c8e-4021-953e-5756518b10b0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.428265] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-336e562f-9c8e-4021-953e-5756518b10b0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.428265] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('336e562f-9c8e-4021-953e-5756518b10b0',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.429113] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-336e562f-9c8e-4021-953e-5756518b10b0 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.429185] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-336e562f-9c8e-4021-953e-5756518b10b0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.429225] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-336e562f-9c8e-4021-953e-5756518b10b0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.429390] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-336e562f-9c8e-4021-953e-5756518b10b0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.429532] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.429644] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.429682] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.429816] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.429900] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.429987] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('336e562f-9c8e-4021-953e-5756518b10b0',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.430713] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-1d540e4b-e19a-4292-9e4b-3a000417f3f6 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.430973] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1d540e4b-e19a-4292-9e4b-3a000417f3f6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.430973] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1d540e4b-e19a-4292-9e4b-3a000417f3f6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.431106] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1d540e4b-e19a-4292-9e4b-3a000417f3f6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.431106] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d540e4b-e19a-4292-9e4b-3a000417f3f6',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.933259] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('336e562f-9c8e-4021-953e-5756518b10b0',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.934872] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-336e562f-9c8e-4021-953e-5756518b10b0 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.934872] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-336e562f-9c8e-4021-953e-5756518b10b0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.935160] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1d540e4b-e19a-4292-9e4b-3a000417f3f6 with status ACTIVE [ 779.935231] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.935360] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.935404] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.935752] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.935992] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.936138] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.936243] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.936310] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.936897] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.936897] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.936897] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.936897] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.937106] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.937106] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.937202] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.937266] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1d540e4b-e19a-4292-9e4b-3a000417f3f6 is going to be updated. [ 779.988046] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.988229] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.988310] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.988476] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.988617] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.988785] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1d540e4b-e19a-4292-9e4b-3a000417f3f6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.440258] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('336e562f-9c8e-4021-953e-5756518b10b0',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.944726] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.944989] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.945131] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.945444] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.945592] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.945750] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 336e562f-9c8e-4021-953e-5756518b10b0 is going to be created. [ 780.972770] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.973239] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.973239] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.973239] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.973387] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.986572] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 336e562f-9c8e-4021-953e-5756518b10b0 in Status: UNINITIALIZED for 2s [ 781.057638] env[70614]: INFO networking_nsxv3.common.synchronization [req-a932ecb2-b647-4a95-b202-347d0e877aad req-0e448580-7015-43a0-b6b6-4822b1a8af1b tempest-ListImageFiltersTestJSON-737813167 tempest-ListImageFiltersTestJSON-737813167-project-member] Enqueued Resource ID: f21a3b6e-da5e-4c92-8717-c114952a5767 with Priority: HIGHEST for action security_group_members [ 781.057940] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f21a3b6e-da5e-4c92-8717-c114952a5767 with Priority: HIGHEST for action security_group_members [ 781.058263] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-f21a3b6e-da5e-4c92-8717-c114952a5767 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.058390] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f21a3b6e-da5e-4c92-8717-c114952a5767" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.058491] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f21a3b6e-da5e-4c92-8717-c114952a5767" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.058693] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f21a3b6e-da5e-4c92-8717-c114952a5767" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.058854] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.058957] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.059805] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.059805] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.059909] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.060044] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f21a3b6e-da5e-4c92-8717-c114952a5767',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.562511] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f21a3b6e-da5e-4c92-8717-c114952a5767',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.066815] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f21a3b6e-da5e-4c92-8717-c114952a5767',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.570977] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.573688] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.573688] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.573688] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.573688] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.573688] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f21a3b6e-da5e-4c92-8717-c114952a5767 is going to be updated. [ 782.608010] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.608918] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.609156] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.609573] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.609890] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.622463] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f21a3b6e-da5e-4c92-8717-c114952a5767 in Status: IN_PROGRESS for 2s [ 782.641984] env[70614]: INFO networking_nsxv3.common.synchronization [None req-93c11712-3e2c-4fa5-8379-daa7f63b921d tempest-AttachInterfacesTestJSON-1919943007 tempest-AttachInterfacesTestJSON-1919943007-project-member] Enqueued Resource ID: 64d5aaad-612c-45e4-8c2c-8d390ad3ffdd with Priority: HIGHEST for action security_group_rules [ 782.642575] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64d5aaad-612c-45e4-8c2c-8d390ad3ffdd with Priority: HIGHEST for action security_group_rules [ 782.642891] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64d5aaad-612c-45e4-8c2c-8d390ad3ffdd taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.643983] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64d5aaad-612c-45e4-8c2c-8d390ad3ffdd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.643983] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64d5aaad-612c-45e4-8c2c-8d390ad3ffdd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.643983] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64d5aaad-612c-45e4-8c2c-8d390ad3ffdd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.644129] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64d5aaad-612c-45e4-8c2c-8d390ad3ffdd',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.767552] env[70614]: INFO networking_nsxv3.common.synchronization [None req-aefcfa55-9a2a-4a37-b843-72c6a7b2c21f tempest-AttachInterfacesTestJSON-1919943007 tempest-AttachInterfacesTestJSON-1919943007-project-member] Enqueued Resource ID: 64d5aaad-612c-45e4-8c2c-8d390ad3ffdd with Priority: HIGHEST for action security_group_rules [ 782.768494] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64d5aaad-612c-45e4-8c2c-8d390ad3ffdd with Priority: HIGHEST for action security_group_rules [ 782.768936] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64d5aaad-612c-45e4-8c2c-8d390ad3ffdd taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.769109] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64d5aaad-612c-45e4-8c2c-8d390ad3ffdd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.997413] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 336e562f-9c8e-4021-953e-5756518b10b0 in Status: SUCCESS [ 782.997698] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-336e562f-9c8e-4021-953e-5756518b10b0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.997855] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-336e562f-9c8e-4021-953e-5756518b10b0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.998105] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-336e562f-9c8e-4021-953e-5756518b10b0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.998334] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.998501] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.998646] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.998701] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.998876] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.998876] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-336e562f-9c8e-4021-953e-5756518b10b0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.998966] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('336e562f-9c8e-4021-953e-5756518b10b0',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.175757] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.175842] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.175970] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.176203] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.176255] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.180031] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64d5aaad-612c-45e4-8c2c-8d390ad3ffdd already deleted. [ 783.180031] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64d5aaad-612c-45e4-8c2c-8d390ad3ffdd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.180031] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64d5aaad-612c-45e4-8c2c-8d390ad3ffdd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.180031] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64d5aaad-612c-45e4-8c2c-8d390ad3ffdd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.180031] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64d5aaad-612c-45e4-8c2c-8d390ad3ffdd',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.501854] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('336e562f-9c8e-4021-953e-5756518b10b0',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.699407] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.699407] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.699407] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.699407] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.699407] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.699407] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64d5aaad-612c-45e4-8c2c-8d390ad3ffdd already deleted. [ 783.699407] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64d5aaad-612c-45e4-8c2c-8d390ad3ffdd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.005466] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 336e562f-9c8e-4021-953e-5756518b10b0: rpc.has_security_group_logging(os_id): False [ 784.023961] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.023961] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.024149] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.024643] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.024643] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.024643] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.024643] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.024844] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.024844] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.024902] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.025032] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 336e562f-9c8e-4021-953e-5756518b10b0 is going to be created. [ 784.085134] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.085703] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.085703] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.085703] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.085858] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.097523] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 336e562f-9c8e-4021-953e-5756518b10b0 in Status: IN_PROGRESS for 2s [ 784.633225] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f21a3b6e-da5e-4c92-8717-c114952a5767 in Status: SUCCESS [ 784.633434] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f21a3b6e-da5e-4c92-8717-c114952a5767" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.027360] env[70614]: INFO networking_nsxv3.common.synchronization [req-22526143-6d14-45d8-9c2e-74c8541ff3be req-006eb12b-be05-4001-a44d-e49777c3db0f tempest-ServersTestJSON-658318484 tempest-ServersTestJSON-658318484-project-member] Enqueued Resource ID: 428bc8ce-d8af-4c27-9ff7-291210f88a0a with Priority: HIGHEST for action security_group_members [ 786.028240] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 428bc8ce-d8af-4c27-9ff7-291210f88a0a with Priority: HIGHEST for action security_group_members [ 786.028943] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-428bc8ce-d8af-4c27-9ff7-291210f88a0a taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.029188] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-428bc8ce-d8af-4c27-9ff7-291210f88a0a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.029310] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-428bc8ce-d8af-4c27-9ff7-291210f88a0a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.030483] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-428bc8ce-d8af-4c27-9ff7-291210f88a0a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.030728] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.030981] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.030981] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.031151] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.031260] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.031412] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('428bc8ce-d8af-4c27-9ff7-291210f88a0a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.116843] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 336e562f-9c8e-4021-953e-5756518b10b0 in Status: SUCCESS [ 786.116843] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-336e562f-9c8e-4021-953e-5756518b10b0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.535897] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.536236] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.536236] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.537968] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.537968] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.537968] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.537968] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.537968] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.537968] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.537968] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.537968] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 428bc8ce-d8af-4c27-9ff7-291210f88a0a is going to be updated. [ 786.573533] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.573707] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.573854] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.574065] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.575359] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.586464] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 428bc8ce-d8af-4c27-9ff7-291210f88a0a in Status: IN_PROGRESS for 2s [ 787.341152] env[70614]: INFO networking_nsxv3.common.synchronization [req-9be35f26-1f28-4e46-b16f-10ce201f5dd6 req-533a2fc6-72c3-41ea-8eee-1d76d05b9845 tempest-ListServersNegativeTestJSON-1075096126 tempest-ListServersNegativeTestJSON-1075096126-project-member] Enqueued Resource ID: 406660af-f92d-476c-ab5f-e3168c58847d with Priority: HIGHEST for action security_group_members [ 787.341453] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 406660af-f92d-476c-ab5f-e3168c58847d with Priority: HIGHEST for action security_group_members [ 787.341453] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-406660af-f92d-476c-ab5f-e3168c58847d taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.341584] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.341640] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.341839] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.347628] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.347628] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.347628] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.347628] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.347628] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.347628] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('406660af-f92d-476c-ab5f-e3168c58847d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.377212] env[70614]: INFO networking_nsxv3.common.synchronization [req-ce2f8e5e-f643-45a1-a1f2-a3ff68850c6f req-2c4e2502-9b90-47e1-8179-198afaa5eba0 tempest-ListServersNegativeTestJSON-1075096126 tempest-ListServersNegativeTestJSON-1075096126-project-member] Enqueued Resource ID: 406660af-f92d-476c-ab5f-e3168c58847d with Priority: HIGHEST for action security_group_members [ 787.377212] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 406660af-f92d-476c-ab5f-e3168c58847d with Priority: HIGHEST for action security_group_members [ 787.377212] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-406660af-f92d-476c-ab5f-e3168c58847d taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.377212] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.848119] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.848286] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.848355] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.848638] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.848756] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.848965] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.849078] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.849144] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.849324] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.849413] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.850276] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 406660af-f92d-476c-ab5f-e3168c58847d is going to be updated. [ 787.880130] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.880130] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.880130] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.880130] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.880130] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.890017] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 406660af-f92d-476c-ab5f-e3168c58847d in Status: IN_PROGRESS for 2s [ 788.597269] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 428bc8ce-d8af-4c27-9ff7-291210f88a0a in Status: SUCCESS [ 788.597566] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 428bc8ce-d8af-4c27-9ff7-291210f88a0a deletion is rescheduled due to dependency. [ 788.597767] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-428bc8ce-d8af-4c27-9ff7-291210f88a0a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.665024] env[70614]: INFO networking_nsxv3.common.synchronization [req-d4d8868c-a9bd-458d-8a8c-17eefa6ad78c req-c1cadedc-93ff-4494-92b7-5fe1a8f043c2 tempest-ServerGroupTestJSON-1399770568 tempest-ServerGroupTestJSON-1399770568-project-member] Enqueued Resource ID: e23923e3-0ade-47cf-aa89-03f9a991b3f7 with Priority: HIGHEST for action security_group_members [ 789.665024] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e23923e3-0ade-47cf-aa89-03f9a991b3f7 with Priority: HIGHEST for action security_group_members [ 789.665024] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-e23923e3-0ade-47cf-aa89-03f9a991b3f7 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.665024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e23923e3-0ade-47cf-aa89-03f9a991b3f7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.665024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e23923e3-0ade-47cf-aa89-03f9a991b3f7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.665797] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e23923e3-0ade-47cf-aa89-03f9a991b3f7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.666071] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.666294] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.666447] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.666703] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.666870] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.667055] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e23923e3-0ade-47cf-aa89-03f9a991b3f7',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.791116] env[70614]: INFO networking_nsxv3.common.synchronization [req-c185d175-a9ec-4bc9-bde9-6bdbedc0a13c req-ec1e04f0-ac4a-4b4d-ba6e-a96aee8c141a tempest-DeleteServersTestJSON-1690139659 tempest-DeleteServersTestJSON-1690139659-project-member] Enqueued Resource ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f with Priority: HIGHEST for action security_group_members [ 789.791628] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f with Priority: HIGHEST for action security_group_members [ 789.791928] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.792070] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.792135] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.792327] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.792673] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.792673] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.792673] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.792912] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.792912] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.792912] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df8f20f5-6e92-4ac4-bdd2-05863ac4905f',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.901137] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 406660af-f92d-476c-ab5f-e3168c58847d in Status: SUCCESS [ 789.901137] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 406660af-f92d-476c-ab5f-e3168c58847d deletion is rescheduled due to dependency. [ 789.901137] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.901137] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.901137] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.901137] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.901137] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.901137] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.901764] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.901764] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.901764] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('406660af-f92d-476c-ab5f-e3168c58847d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.077364] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-364 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.077631] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-364" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.077768] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-364" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.078108] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-364" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.078451] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.078687] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.078785] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.079044] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.079205] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.079451] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 790.079566] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 790.079682] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 790.079792] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 790.079902] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 790.080013] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 790.080149] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 790.104324] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 790.104505] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 790.104647] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 790.104838] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-364" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.105208] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-f984e3fe-ec07-4d23-b54f-979ec72e588d taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.105389] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-f984e3fe-ec07-4d23-b54f-979ec72e588d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.105511] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-f984e3fe-ec07-4d23-b54f-979ec72e588d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.105843] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-f984e3fe-ec07-4d23-b54f-979ec72e588d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.105987] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f984e3fe-ec07-4d23-b54f-979ec72e588d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.171807] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.171981] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.172062] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.172321] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.172362] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.172575] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.172686] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.172950] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.173183] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.173272] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.173360] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e23923e3-0ade-47cf-aa89-03f9a991b3f7 already deleted. [ 790.173450] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e23923e3-0ade-47cf-aa89-03f9a991b3f7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.295258] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.295482] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.295578] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.295798] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.295890] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.296097] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.296196] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.296256] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.296413] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.296594] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.296594] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f is going to be updated. [ 790.326029] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.326029] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.326029] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.326029] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.326029] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.334666] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f in Status: IN_PROGRESS for 2s [ 790.406719] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.406719] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.406719] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.406719] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.406719] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.406719] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.406719] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.406719] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.406719] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.406719] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.406719] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 406660af-f92d-476c-ab5f-e3168c58847d is going to be updated. [ 790.461035] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.461035] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.461035] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.461035] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.461035] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.472892] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 406660af-f92d-476c-ab5f-e3168c58847d in Status: IN_PROGRESS for 2s [ 790.611789] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.611789] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.611789] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.611789] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.612029] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.612067] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port f984e3fe-ec07-4d23-b54f-979ec72e588d not found, creating... [ 790.612349] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.612495] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.612609] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.612966] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.612966] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.613987] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.613987] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.613987] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.613987] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.613987] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.613987] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: f984e3fe-ec07-4d23-b54f-979ec72e588d is going to be created. [ 790.637287] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.637394] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.637582] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.637966] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.638136] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.638335] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-f984e3fe-ec07-4d23-b54f-979ec72e588d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.972269] env[70614]: INFO networking_nsxv3.common.synchronization [req-8e5fa3dd-b90d-4042-9aaf-51017cfb019a req-e0ff59c0-7375-4f0a-a9b0-c52036e22e60 tempest-ImagesTestJSON-1765947257 tempest-ImagesTestJSON-1765947257-project-member] Enqueued Resource ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 with Priority: HIGHEST for action security_group_members [ 790.974287] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 with Priority: HIGHEST for action security_group_members [ 790.974605] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-04a082fe-52f7-4ac6-a12b-63791c63be86 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.974711] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.974782] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.975031] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.975188] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.975284] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.975347] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.975491] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.975567] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.975659] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04a082fe-52f7-4ac6-a12b-63791c63be86',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.478098] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.480484] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.480484] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.480484] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.480484] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.480484] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.480484] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.480484] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.480484] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.480484] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.480484] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 already deleted. [ 791.480484] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.597830] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-12 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.598011] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-12" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.598135] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-12" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.598601] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-12" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.599138] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.599138] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.600668] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.600668] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.600668] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.601048] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 791.601151] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 791.602295] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 791.602295] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 791.602367] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 791.602565] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 791.602676] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 791.628214] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 791.628382] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 791.628518] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 791.628711] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-12" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.629100] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-00f6829f-1d31-4f18-82c2-59a20cb164d9 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.629951] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-00f6829f-1d31-4f18-82c2-59a20cb164d9" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.629951] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-00f6829f-1d31-4f18-82c2-59a20cb164d9" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.629951] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-00f6829f-1d31-4f18-82c2-59a20cb164d9" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.629951] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('00f6829f-1d31-4f18-82c2-59a20cb164d9',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.649786] env[70614]: INFO networking_nsxv3.common.synchronization [req-d4d8868c-a9bd-458d-8a8c-17eefa6ad78c req-4ae0717b-d7e7-4351-be16-4c8f9d3564c2 service nova] Enqueued Resource ID: e23923e3-0ade-47cf-aa89-03f9a991b3f7 with Priority: HIGHEST for action security_group_rules [ 791.649982] env[70614]: INFO networking_nsxv3.common.synchronization [req-d4d8868c-a9bd-458d-8a8c-17eefa6ad78c req-4ae0717b-d7e7-4351-be16-4c8f9d3564c2 service nova] Enqueued Resource ID: e23923e3-0ade-47cf-aa89-03f9a991b3f7 with Priority: HIGHEST for action security_group_members [ 791.650149] env[70614]: INFO networking_nsxv3.common.synchronization [req-d4d8868c-a9bd-458d-8a8c-17eefa6ad78c req-4ae0717b-d7e7-4351-be16-4c8f9d3564c2 service nova] Enqueued Resource ID: f984e3fe-ec07-4d23-b54f-979ec72e588d with Priority: HIGHEST for action port [ 791.651464] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e23923e3-0ade-47cf-aa89-03f9a991b3f7 with Priority: HIGHEST for action security_group_rules [ 791.651464] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e23923e3-0ade-47cf-aa89-03f9a991b3f7 with Priority: HIGHEST for action security_group_members [ 791.651464] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f984e3fe-ec07-4d23-b54f-979ec72e588d with Priority: HIGHEST for action port [ 791.654281] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e23923e3-0ade-47cf-aa89-03f9a991b3f7 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.654466] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e23923e3-0ade-47cf-aa89-03f9a991b3f7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.654466] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e23923e3-0ade-47cf-aa89-03f9a991b3f7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.654871] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e23923e3-0ade-47cf-aa89-03f9a991b3f7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.655401] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e23923e3-0ade-47cf-aa89-03f9a991b3f7',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.656054] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-e23923e3-0ade-47cf-aa89-03f9a991b3f7 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.656855] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e23923e3-0ade-47cf-aa89-03f9a991b3f7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.656855] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e23923e3-0ade-47cf-aa89-03f9a991b3f7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.656855] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e23923e3-0ade-47cf-aa89-03f9a991b3f7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.656855] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.656855] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.656855] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.656855] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.657266] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.657266] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e23923e3-0ade-47cf-aa89-03f9a991b3f7',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.662825] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-f984e3fe-ec07-4d23-b54f-979ec72e588d taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.663340] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f984e3fe-ec07-4d23-b54f-979ec72e588d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.663340] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f984e3fe-ec07-4d23-b54f-979ec72e588d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.663457] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f984e3fe-ec07-4d23-b54f-979ec72e588d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.666021] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f984e3fe-ec07-4d23-b54f-979ec72e588d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.132626] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.132907] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.132907] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.133137] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.133311] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.133567] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 00f6829f-1d31-4f18-82c2-59a20cb164d9 not found, creating... [ 792.134441] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.134753] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.134959] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.135508] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.135508] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.135940] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.136194] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.136341] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.136693] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.136916] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.137156] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 00f6829f-1d31-4f18-82c2-59a20cb164d9 is going to be created. [ 792.166648] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-e23923e3-0ade-47cf-aa89-03f9a991b3f7 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.166832] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e23923e3-0ade-47cf-aa89-03f9a991b3f7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.167039] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e23923e3-0ade-47cf-aa89-03f9a991b3f7',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.168163] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f984e3fe-ec07-4d23-b54f-979ec72e588d with status ACTIVE [ 792.168289] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.168409] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.168476] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.168707] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.169952] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.169952] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.169952] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.169952] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.169952] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.169952] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.169952] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.169952] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.169952] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.169952] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.169952] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.170483] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f984e3fe-ec07-4d23-b54f-979ec72e588d is going to be updated. [ 792.172360] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.172360] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.172469] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.173232] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.173232] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.173232] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-00f6829f-1d31-4f18-82c2-59a20cb164d9" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.208996] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.209158] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.209203] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.209754] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.209754] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.209754] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f984e3fe-ec07-4d23-b54f-979ec72e588d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.350493] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f in Status: SUCCESS [ 792.350713] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f deletion is rescheduled due to dependency. [ 792.350784] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.486422] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 406660af-f92d-476c-ab5f-e3168c58847d in Status: SUCCESS [ 792.486704] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 406660af-f92d-476c-ab5f-e3168c58847d deletion is rescheduled due to dependency. [ 792.486832] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.672246] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e23923e3-0ade-47cf-aa89-03f9a991b3f7',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.766565] env[70614]: INFO networking_nsxv3.common.synchronization [req-2095aebf-2236-47bd-a9c6-5c58c1a0b0b0 req-a3b6f2df-edf1-479b-b93b-3e3bd5df9172 tempest-ServersWithSpecificFlavorTestJSON-1815410269 tempest-ServersWithSpecificFlavorTestJSON-1815410269-project-member] Enqueued Resource ID: ca9b1416-779b-4bc5-ae29-5117ebb9bc1a with Priority: HIGHEST for action security_group_members [ 792.767250] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca9b1416-779b-4bc5-ae29-5117ebb9bc1a with Priority: HIGHEST for action security_group_members [ 792.767660] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.767808] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.769850] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.771236] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.771236] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.771236] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.771236] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.771236] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.771236] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.771236] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca9b1416-779b-4bc5-ae29-5117ebb9bc1a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.104878] env[70614]: INFO networking_nsxv3.common.synchronization [req-8e5fa3dd-b90d-4042-9aaf-51017cfb019a req-66e945d3-9f35-4ac3-b627-f33552025eee service nova] Enqueued Resource ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 with Priority: HIGHEST for action security_group_rules [ 793.105082] env[70614]: INFO networking_nsxv3.common.synchronization [req-8e5fa3dd-b90d-4042-9aaf-51017cfb019a req-66e945d3-9f35-4ac3-b627-f33552025eee service nova] Enqueued Resource ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 with Priority: HIGHEST for action security_group_members [ 793.105225] env[70614]: INFO networking_nsxv3.common.synchronization [req-8e5fa3dd-b90d-4042-9aaf-51017cfb019a req-66e945d3-9f35-4ac3-b627-f33552025eee service nova] Enqueued Resource ID: 00f6829f-1d31-4f18-82c2-59a20cb164d9 with Priority: HIGHEST for action port [ 793.105539] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 with Priority: HIGHEST for action security_group_rules [ 793.105812] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 with Priority: HIGHEST for action security_group_members [ 793.105937] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00f6829f-1d31-4f18-82c2-59a20cb164d9 with Priority: HIGHEST for action port [ 793.110270] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-04a082fe-52f7-4ac6-a12b-63791c63be86 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.110461] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.110558] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.110887] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.111404] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('04a082fe-52f7-4ac6-a12b-63791c63be86',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.112856] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-04a082fe-52f7-4ac6-a12b-63791c63be86 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.112856] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.112856] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.113079] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.113300] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.113300] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.113397] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.113493] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.113556] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.113649] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04a082fe-52f7-4ac6-a12b-63791c63be86',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.114566] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-00f6829f-1d31-4f18-82c2-59a20cb164d9 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.114679] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-00f6829f-1d31-4f18-82c2-59a20cb164d9" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.114741] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-00f6829f-1d31-4f18-82c2-59a20cb164d9" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.114984] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-00f6829f-1d31-4f18-82c2-59a20cb164d9" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.115077] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('00f6829f-1d31-4f18-82c2-59a20cb164d9',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.175407] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.175769] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.175861] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.176099] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.176195] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.176298] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e23923e3-0ade-47cf-aa89-03f9a991b3f7 is going to be created. [ 793.206640] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.206733] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.206780] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.206961] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.207129] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.225512] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e23923e3-0ade-47cf-aa89-03f9a991b3f7 in Status: UNINITIALIZED for 2s [ 793.273891] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.273891] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.273891] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.274994] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.274994] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.274994] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.274994] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.274994] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.274994] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.274994] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.274994] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca9b1416-779b-4bc5-ae29-5117ebb9bc1a is going to be updated. [ 793.313726] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.313883] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.313959] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.314177] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.314319] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.327242] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca9b1416-779b-4bc5-ae29-5117ebb9bc1a in Status: IN_PROGRESS for 2s [ 793.617142] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('04a082fe-52f7-4ac6-a12b-63791c63be86',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.619080] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-04a082fe-52f7-4ac6-a12b-63791c63be86 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.619080] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.619261] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 00f6829f-1d31-4f18-82c2-59a20cb164d9 with status ACTIVE [ 793.619568] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.619568] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.619709] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.619860] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.620050] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.620115] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.620242] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.620285] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.620443] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.620650] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.620757] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.621046] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.621046] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.621297] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.621381] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.621469] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 00f6829f-1d31-4f18-82c2-59a20cb164d9 is going to be updated. [ 793.649817] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.649817] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.649817] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.649817] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.649817] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.649817] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-00f6829f-1d31-4f18-82c2-59a20cb164d9" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.770488] env[70614]: INFO networking_nsxv3.common.synchronization [req-3277b696-ed70-475d-ad70-87cca17a0d66 req-c220871e-59d1-4e18-83df-3333d5efb968 tempest-ServersAdminTestJSON-365827888 tempest-ServersAdminTestJSON-365827888-project-member] Enqueued Resource ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b with Priority: HIGHEST for action security_group_members [ 793.771049] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b with Priority: HIGHEST for action security_group_members [ 793.771351] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.771499] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.771557] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.771731] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.772226] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.772226] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.772226] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.772226] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.772483] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.772483] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.126968] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('04a082fe-52f7-4ac6-a12b-63791c63be86',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.279721] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.299511] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-746 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.299695] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-746" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.301940] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-746" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.302341] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-746" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.302659] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.303474] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.303646] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.303908] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.304084] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.304315] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 794.304494] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 794.304561] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 794.304647] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 794.304727] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 794.304938] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 794.305016] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 794.324966] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 794.325154] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 794.325290] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 794.325467] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-746" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.325956] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-2440a658-b42d-4523-90ff-81beb9514349 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.326232] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-2440a658-b42d-4523-90ff-81beb9514349" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.326364] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-2440a658-b42d-4523-90ff-81beb9514349" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.326694] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-2440a658-b42d-4523-90ff-81beb9514349" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.326892] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2440a658-b42d-4523-90ff-81beb9514349',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.629552] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.629716] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.629791] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.630018] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.630111] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.630213] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 is going to be created. [ 794.659715] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.659715] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.659715] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.659715] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.659715] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.669675] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 in Status: UNINITIALIZED for 2s [ 794.779484] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.829930] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.833020] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.833020] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.833020] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.833020] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.833020] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 2440a658-b42d-4523-90ff-81beb9514349 not found, creating... [ 794.833020] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.833020] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.833020] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.833020] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.833020] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.833450] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.833450] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.833450] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.833450] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.834859] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.835140] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 2440a658-b42d-4523-90ff-81beb9514349 is going to be created. [ 794.860149] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.860149] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.860149] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.860149] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.860149] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.860149] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-2440a658-b42d-4523-90ff-81beb9514349" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.238057] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e23923e3-0ade-47cf-aa89-03f9a991b3f7 in Status: SUCCESS [ 795.238326] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e23923e3-0ade-47cf-aa89-03f9a991b3f7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.238566] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e23923e3-0ade-47cf-aa89-03f9a991b3f7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.238860] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e23923e3-0ade-47cf-aa89-03f9a991b3f7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.239084] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.239211] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.239278] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.239441] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.239528] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.239602] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e23923e3-0ade-47cf-aa89-03f9a991b3f7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.239700] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e23923e3-0ade-47cf-aa89-03f9a991b3f7',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.283070] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.283070] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.283070] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.283497] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.283497] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.283686] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b is going to be updated. [ 795.317241] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.317241] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.317420] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.317651] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.317831] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.328058] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b in Status: IN_PROGRESS for 2s [ 795.335602] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca9b1416-779b-4bc5-ae29-5117ebb9bc1a in Status: SUCCESS [ 795.335847] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca9b1416-779b-4bc5-ae29-5117ebb9bc1a deletion is rescheduled due to dependency. [ 795.335933] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.742549] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-e23923e3-0ade-47cf-aa89-03f9a991b3f7 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.742742] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e23923e3-0ade-47cf-aa89-03f9a991b3f7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.742817] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e23923e3-0ade-47cf-aa89-03f9a991b3f7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.743048] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e23923e3-0ade-47cf-aa89-03f9a991b3f7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.743216] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.743319] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.743383] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.743534] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.743623] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.743754] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e23923e3-0ade-47cf-aa89-03f9a991b3f7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.743851] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-e23923e3-0ade-47cf-aa89-03f9a991b3f7 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.743947] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e23923e3-0ade-47cf-aa89-03f9a991b3f7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.744014] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e23923e3-0ade-47cf-aa89-03f9a991b3f7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.744158] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e23923e3-0ade-47cf-aa89-03f9a991b3f7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.744333] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.744431] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.744491] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.744627] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.744700] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.744788] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e23923e3-0ade-47cf-aa89-03f9a991b3f7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.744958] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e23923e3-0ade-47cf-aa89-03f9a991b3f7',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.837038] env[70614]: INFO networking_nsxv3.common.synchronization [req-3277b696-ed70-475d-ad70-87cca17a0d66 req-eaa8b2bd-bdc1-4a69-9268-d21f03a459db service nova] Enqueued Resource ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b with Priority: HIGHEST for action security_group_rules [ 795.837260] env[70614]: INFO networking_nsxv3.common.synchronization [req-3277b696-ed70-475d-ad70-87cca17a0d66 req-eaa8b2bd-bdc1-4a69-9268-d21f03a459db service nova] Enqueued Resource ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b with Priority: HIGHEST for action security_group_members [ 795.837397] env[70614]: INFO networking_nsxv3.common.synchronization [req-3277b696-ed70-475d-ad70-87cca17a0d66 req-eaa8b2bd-bdc1-4a69-9268-d21f03a459db service nova] Enqueued Resource ID: 2440a658-b42d-4523-90ff-81beb9514349 with Priority: HIGHEST for action port [ 795.837649] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b with Priority: HIGHEST for action security_group_rules [ 795.837782] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b with Priority: HIGHEST for action security_group_members [ 795.837877] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2440a658-b42d-4523-90ff-81beb9514349 with Priority: HIGHEST for action port [ 795.838419] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.838650] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.838738] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.838937] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.839027] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.840186] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.840294] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.840487] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-2440a658-b42d-4523-90ff-81beb9514349 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.840594] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2440a658-b42d-4523-90ff-81beb9514349" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.843280] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2440a658-b42d-4523-90ff-81beb9514349" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.843280] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2440a658-b42d-4523-90ff-81beb9514349" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.843280] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2440a658-b42d-4523-90ff-81beb9514349',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.247495] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e23923e3-0ade-47cf-aa89-03f9a991b3f7: rpc.has_security_group_logging(os_id): False [ 796.268168] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.268168] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.268168] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.268168] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.268168] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.268168] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.268168] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.268168] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.268708] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.268708] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.268708] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.268708] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.268708] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.268927] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.268997] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.269205] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.269288] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.269351] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.269487] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.269561] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.269644] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e23923e3-0ade-47cf-aa89-03f9a991b3f7 is going to be created. [ 796.327150] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.327518] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.327518] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.327592] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.327783] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.340872] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e23923e3-0ade-47cf-aa89-03f9a991b3f7 in Status: IN_PROGRESS for 2s [ 796.342400] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.342552] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.345824] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2440a658-b42d-4523-90ff-81beb9514349 with status ACTIVE [ 796.346030] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.346166] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.346253] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.346550] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.346746] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.346862] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.346937] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.347010] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.347170] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.347263] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.347570] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.347665] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.347702] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.351020] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.351020] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.351020] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2440a658-b42d-4523-90ff-81beb9514349 is going to be updated. [ 796.370525] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.370676] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.370861] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.370944] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.371091] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.371245] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2440a658-b42d-4523-90ff-81beb9514349" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.680533] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 in Status: SUCCESS [ 796.680533] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.680533] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.680533] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.680533] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.681028] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.681028] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.681028] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.681028] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.681028] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.681309] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('04a082fe-52f7-4ac6-a12b-63791c63be86',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.187155] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-04a082fe-52f7-4ac6-a12b-63791c63be86 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.187155] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.187155] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.187155] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.187155] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.187155] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.187155] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.187155] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.187155] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.187155] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.187155] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-04a082fe-52f7-4ac6-a12b-63791c63be86 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.187155] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.187155] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.187604] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.187604] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.187604] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.187604] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.187791] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.187791] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.187851] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.187983] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('04a082fe-52f7-4ac6-a12b-63791c63be86',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.344286] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b in Status: SUCCESS [ 797.344286] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.344286] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.344286] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.344286] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.344286] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.344286] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.344286] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.345881] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.345881] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.689720] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 04a082fe-52f7-4ac6-a12b-63791c63be86: rpc.has_security_group_logging(os_id): False [ 797.708754] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.708991] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.709055] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.709241] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.709332] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.709574] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.709701] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.709750] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.709916] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.710035] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.710160] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.710272] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.710326] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.710454] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.710560] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.710769] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.710864] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.710963] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.711084] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.711159] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.711250] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 is going to be created. [ 797.777405] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.777561] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.777695] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.777926] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.778135] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.794022] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 in Status: IN_PROGRESS for 2s [ 797.851545] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.354338] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.356069] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e23923e3-0ade-47cf-aa89-03f9a991b3f7 in Status: SUCCESS [ 798.356265] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e23923e3-0ade-47cf-aa89-03f9a991b3f7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.858060] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.858329] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.858329] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.858540] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.858669] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.859915] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b is going to be updated. [ 798.887820] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.888022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.888073] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.888298] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.888460] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.898278] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b in Status: IN_PROGRESS for 2s [ 799.419387] env[70614]: INFO networking_nsxv3.common.synchronization [req-2dfe93b9-5cc6-42bd-82ce-c1a56bc64973 req-ef848b02-0850-4956-b76e-7029c31e593e tempest-ServerDiagnosticsNegativeTest-1572490138 tempest-ServerDiagnosticsNegativeTest-1572490138-project-member] Enqueued Resource ID: ecaff113-395f-46a3-b8a5-a3ce5cb003a5 with Priority: HIGHEST for action security_group_members [ 799.420144] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ecaff113-395f-46a3-b8a5-a3ce5cb003a5 with Priority: HIGHEST for action security_group_members [ 799.420410] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-ecaff113-395f-46a3-b8a5-a3ce5cb003a5 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.420555] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ecaff113-395f-46a3-b8a5-a3ce5cb003a5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.420639] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ecaff113-395f-46a3-b8a5-a3ce5cb003a5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.420960] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ecaff113-395f-46a3-b8a5-a3ce5cb003a5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.421570] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.421783] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.422108] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.422389] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.422544] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.422667] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ecaff113-395f-46a3-b8a5-a3ce5cb003a5',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.810031] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 in Status: SUCCESS [ 799.810031] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.903830] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-573 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.904045] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-573" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.904166] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-573" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.904488] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-573" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.904774] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.904939] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.905074] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.905300] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.905472] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.905691] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 799.905809] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 799.905947] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 799.906067] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 799.906184] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 799.906289] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 799.906429] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 799.925675] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.925675] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.925675] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.925675] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.926051] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.926051] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.926051] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.926163] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.926238] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.926309] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.926395] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ecaff113-395f-46a3-b8a5-a3ce5cb003a5 already deleted. [ 799.926489] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ecaff113-395f-46a3-b8a5-a3ce5cb003a5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.927469] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 799.927669] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 799.927807] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 799.928047] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-573" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.928292] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-bc12dcff-133d-4018-9f99-d89859c9eb86 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.928449] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-bc12dcff-133d-4018-9f99-d89859c9eb86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.928568] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-bc12dcff-133d-4018-9f99-d89859c9eb86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.928911] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-bc12dcff-133d-4018-9f99-d89859c9eb86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.929088] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc12dcff-133d-4018-9f99-d89859c9eb86',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.432898] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.433456] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.433626] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.434018] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.434269] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.434520] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port bc12dcff-133d-4018-9f99-d89859c9eb86 not found, creating... [ 800.434871] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.435092] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.435281] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.435511] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.435732] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.436104] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.436391] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.436581] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.436865] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.437038] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.437230] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: bc12dcff-133d-4018-9f99-d89859c9eb86 is going to be created. [ 800.461945] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.462292] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.462468] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.463152] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.463541] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.463719] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-bc12dcff-133d-4018-9f99-d89859c9eb86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.909155] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b in Status: SUCCESS [ 800.909430] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.909578] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.909819] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.909987] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.910119] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.910184] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.910338] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.910429] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.910512] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.910605] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.237298] env[70614]: INFO networking_nsxv3.common.synchronization [req-2dfe93b9-5cc6-42bd-82ce-c1a56bc64973 req-b6e2939f-72d5-40fd-b568-703978aa486e service nova] Enqueued Resource ID: ecaff113-395f-46a3-b8a5-a3ce5cb003a5 with Priority: HIGHEST for action security_group_rules [ 801.237298] env[70614]: INFO networking_nsxv3.common.synchronization [req-2dfe93b9-5cc6-42bd-82ce-c1a56bc64973 req-b6e2939f-72d5-40fd-b568-703978aa486e service nova] Enqueued Resource ID: ecaff113-395f-46a3-b8a5-a3ce5cb003a5 with Priority: HIGHEST for action security_group_members [ 801.237298] env[70614]: INFO networking_nsxv3.common.synchronization [req-2dfe93b9-5cc6-42bd-82ce-c1a56bc64973 req-b6e2939f-72d5-40fd-b568-703978aa486e service nova] Enqueued Resource ID: bc12dcff-133d-4018-9f99-d89859c9eb86 with Priority: HIGHEST for action port [ 801.237298] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ecaff113-395f-46a3-b8a5-a3ce5cb003a5 with Priority: HIGHEST for action security_group_rules [ 801.237298] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ecaff113-395f-46a3-b8a5-a3ce5cb003a5 with Priority: HIGHEST for action security_group_members [ 801.237298] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc12dcff-133d-4018-9f99-d89859c9eb86 with Priority: HIGHEST for action port [ 801.237298] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ecaff113-395f-46a3-b8a5-a3ce5cb003a5 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.237298] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ecaff113-395f-46a3-b8a5-a3ce5cb003a5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.237947] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ecaff113-395f-46a3-b8a5-a3ce5cb003a5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.238344] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ecaff113-395f-46a3-b8a5-a3ce5cb003a5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.238972] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ecaff113-395f-46a3-b8a5-a3ce5cb003a5',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.240338] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-ecaff113-395f-46a3-b8a5-a3ce5cb003a5 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.240338] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ecaff113-395f-46a3-b8a5-a3ce5cb003a5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.240338] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ecaff113-395f-46a3-b8a5-a3ce5cb003a5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.240338] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ecaff113-395f-46a3-b8a5-a3ce5cb003a5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.240831] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.243020] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.243020] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.243020] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.243020] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.243020] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ecaff113-395f-46a3-b8a5-a3ce5cb003a5',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.243020] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-bc12dcff-133d-4018-9f99-d89859c9eb86 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.243020] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bc12dcff-133d-4018-9f99-d89859c9eb86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.243020] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bc12dcff-133d-4018-9f99-d89859c9eb86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.243020] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bc12dcff-133d-4018-9f99-d89859c9eb86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.243020] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc12dcff-133d-4018-9f99-d89859c9eb86',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.414799] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.415032] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.415032] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.415232] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.415392] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.415492] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.415569] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.415737] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.415832] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.415920] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.416106] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.416184] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.416228] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.416371] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.416505] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.416594] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.416664] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.416833] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.416915] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.416990] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.417090] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.745227] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-ecaff113-395f-46a3-b8a5-a3ce5cb003a5 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.745566] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ecaff113-395f-46a3-b8a5-a3ce5cb003a5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.745608] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ecaff113-395f-46a3-b8a5-a3ce5cb003a5',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.748408] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bc12dcff-133d-4018-9f99-d89859c9eb86 with status ACTIVE [ 801.749042] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.749042] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.749042] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.749042] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.749341] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.749403] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.749593] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.749593] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.749717] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.749801] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.749989] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.750113] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.750200] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.750357] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.750442] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.750528] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bc12dcff-133d-4018-9f99-d89859c9eb86 is going to be updated. [ 801.773446] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.773571] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.773642] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.773925] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.773988] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.774179] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bc12dcff-133d-4018-9f99-d89859c9eb86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.919677] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b: rpc.has_security_group_logging(os_id): False [ 801.946013] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.946263] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.946350] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.946679] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.946810] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.947170] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.947324] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.947421] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.947721] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.947869] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.948160] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.948314] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.948373] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.948617] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.948797] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.949075] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.949207] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.949389] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.949627] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.949939] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.950121] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b is going to be updated. [ 802.045232] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.045232] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.045232] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.045453] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.045687] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.059762] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b in Status: IN_PROGRESS for 2s [ 802.247959] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ecaff113-395f-46a3-b8a5-a3ce5cb003a5',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.751653] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.751653] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.751653] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.751653] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.751653] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.751653] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ecaff113-395f-46a3-b8a5-a3ce5cb003a5 is going to be created. [ 802.783600] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.783831] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.783896] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.784151] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.784339] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.794236] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ecaff113-395f-46a3-b8a5-a3ce5cb003a5 in Status: UNINITIALIZED for 2s [ 803.566187] env[70614]: INFO networking_nsxv3.common.synchronization [req-3d0aee10-b45d-4018-a54b-a13ff8d1aa25 req-f1574379-ee07-4ed1-a717-45b11b2a59e5 tempest-ServerGroupTestJSON-1399770568 tempest-ServerGroupTestJSON-1399770568-project-member] Enqueued Resource ID: e23923e3-0ade-47cf-aa89-03f9a991b3f7 with Priority: HIGHEST for action security_group_members [ 803.566716] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e23923e3-0ade-47cf-aa89-03f9a991b3f7 with Priority: HIGHEST for action security_group_members [ 803.567114] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-e23923e3-0ade-47cf-aa89-03f9a991b3f7 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.567176] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e23923e3-0ade-47cf-aa89-03f9a991b3f7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.567239] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e23923e3-0ade-47cf-aa89-03f9a991b3f7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.567442] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e23923e3-0ade-47cf-aa89-03f9a991b3f7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.567592] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.567731] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.567796] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.567946] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.568044] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.568179] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e23923e3-0ade-47cf-aa89-03f9a991b3f7',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.070336] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.070336] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.070654] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.070841] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.070978] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.072243] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.072243] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.072243] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.072243] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.072243] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.072243] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e23923e3-0ade-47cf-aa89-03f9a991b3f7 is going to be updated. [ 804.075020] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b in Status: SUCCESS [ 804.075102] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.106644] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.106790] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.106861] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.107075] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.107225] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.118310] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e23923e3-0ade-47cf-aa89-03f9a991b3f7 in Status: IN_PROGRESS for 2s [ 804.805306] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ecaff113-395f-46a3-b8a5-a3ce5cb003a5 in Status: SUCCESS [ 804.805565] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ecaff113-395f-46a3-b8a5-a3ce5cb003a5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.805801] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ecaff113-395f-46a3-b8a5-a3ce5cb003a5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.806059] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ecaff113-395f-46a3-b8a5-a3ce5cb003a5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.806286] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.806436] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.806524] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.806713] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.806825] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.806931] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ecaff113-395f-46a3-b8a5-a3ce5cb003a5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.807048] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ecaff113-395f-46a3-b8a5-a3ce5cb003a5',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.309238] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-ecaff113-395f-46a3-b8a5-a3ce5cb003a5 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.309596] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ecaff113-395f-46a3-b8a5-a3ce5cb003a5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.309596] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ecaff113-395f-46a3-b8a5-a3ce5cb003a5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.309670] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ecaff113-395f-46a3-b8a5-a3ce5cb003a5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.309832] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.309932] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.310034] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.310160] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.310248] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.310341] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ecaff113-395f-46a3-b8a5-a3ce5cb003a5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.310473] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-ecaff113-395f-46a3-b8a5-a3ce5cb003a5 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.310566] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ecaff113-395f-46a3-b8a5-a3ce5cb003a5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.310629] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ecaff113-395f-46a3-b8a5-a3ce5cb003a5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.310771] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ecaff113-395f-46a3-b8a5-a3ce5cb003a5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.310971] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.311083] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.311143] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.311372] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.311452] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.311536] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ecaff113-395f-46a3-b8a5-a3ce5cb003a5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.311628] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ecaff113-395f-46a3-b8a5-a3ce5cb003a5',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.817507] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ecaff113-395f-46a3-b8a5-a3ce5cb003a5: rpc.has_security_group_logging(os_id): False [ 805.837763] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.837981] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.838050] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.838303] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.838429] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.838612] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.838755] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.838809] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.839074] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.839074] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.839239] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.839333] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.839401] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.839561] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.839636] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.839865] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.839965] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.840046] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.840223] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.840317] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.840423] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ecaff113-395f-46a3-b8a5-a3ce5cb003a5 is going to be created. [ 805.900576] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.900683] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.900737] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.901021] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.901229] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.915837] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ecaff113-395f-46a3-b8a5-a3ce5cb003a5 in Status: IN_PROGRESS for 2s [ 806.128854] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e23923e3-0ade-47cf-aa89-03f9a991b3f7 in Status: SUCCESS [ 806.129172] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e23923e3-0ade-47cf-aa89-03f9a991b3f7 deletion is rescheduled due to dependency. [ 806.129284] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e23923e3-0ade-47cf-aa89-03f9a991b3f7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.929599] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ecaff113-395f-46a3-b8a5-a3ce5cb003a5 in Status: SUCCESS [ 807.929968] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ecaff113-395f-46a3-b8a5-a3ce5cb003a5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.568071] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 808.568218] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 808.896827] env[70614]: INFO networking_nsxv3.common.synchronization [None req-50fca929-a0fc-478d-95b1-b8575308a213 tempest-ImagesOneServerNegativeTestJSON-1769697081 tempest-ImagesOneServerNegativeTestJSON-1769697081-project-member] Enqueued Resource ID: e6732281-1680-4bf4-ac75-86b35f364cd5 with Priority: HIGHEST for action security_group_rules [ 808.897640] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6732281-1680-4bf4-ac75-86b35f364cd5 with Priority: HIGHEST for action security_group_rules [ 808.898549] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e6732281-1680-4bf4-ac75-86b35f364cd5 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.898709] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e6732281-1680-4bf4-ac75-86b35f364cd5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.898779] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e6732281-1680-4bf4-ac75-86b35f364cd5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.899083] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e6732281-1680-4bf4-ac75-86b35f364cd5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.899176] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e6732281-1680-4bf4-ac75-86b35f364cd5',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.001505] env[70614]: INFO networking_nsxv3.common.synchronization [None req-cd9a4486-d6d9-48c2-be76-35d48223d01f tempest-ImagesOneServerNegativeTestJSON-1769697081 tempest-ImagesOneServerNegativeTestJSON-1769697081-project-member] Enqueued Resource ID: e6732281-1680-4bf4-ac75-86b35f364cd5 with Priority: HIGHEST for action security_group_rules [ 809.002248] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6732281-1680-4bf4-ac75-86b35f364cd5 with Priority: HIGHEST for action security_group_rules [ 809.002750] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e6732281-1680-4bf4-ac75-86b35f364cd5 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.002813] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e6732281-1680-4bf4-ac75-86b35f364cd5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.424269] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.425382] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.425589] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.425896] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.426102] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.426283] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e6732281-1680-4bf4-ac75-86b35f364cd5 already deleted. [ 809.426452] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e6732281-1680-4bf4-ac75-86b35f364cd5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.426855] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e6732281-1680-4bf4-ac75-86b35f364cd5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.427971] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e6732281-1680-4bf4-ac75-86b35f364cd5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.428199] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e6732281-1680-4bf4-ac75-86b35f364cd5',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.956980] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.956980] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.956980] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.956980] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.956980] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.956980] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e6732281-1680-4bf4-ac75-86b35f364cd5 already deleted. [ 809.956980] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e6732281-1680-4bf4-ac75-86b35f364cd5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.196198] env[70614]: INFO networking_nsxv3.common.synchronization [req-9acac3f2-43f6-4b48-9f39-b16863b3777a req-ea3dbd0c-4795-4591-83b3-45d24cd26d0a tempest-ServerAddressesNegativeTestJSON-538390798 tempest-ServerAddressesNegativeTestJSON-538390798-project-member] Enqueued Resource ID: 327db6cf-92fa-437c-b166-c5060f6230e2 with Priority: HIGHEST for action security_group_members [ 812.196198] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 327db6cf-92fa-437c-b166-c5060f6230e2 with Priority: HIGHEST for action security_group_members [ 812.196198] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-327db6cf-92fa-437c-b166-c5060f6230e2 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.196198] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-327db6cf-92fa-437c-b166-c5060f6230e2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.196198] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-327db6cf-92fa-437c-b166-c5060f6230e2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.196198] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-327db6cf-92fa-437c-b166-c5060f6230e2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.196198] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.196198] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.196198] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.196198] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.196198] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.196198] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('327db6cf-92fa-437c-b166-c5060f6230e2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.657102] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-621 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.657243] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-621" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.657302] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-621" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.657785] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-621" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.658314] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.658314] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.658314] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.658522] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.658664] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.658909] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 812.659076] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 812.659249] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 812.659249] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 812.659579] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 812.659579] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 812.659672] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 812.686038] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 812.686038] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 812.686038] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 812.686038] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-621" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.686038] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-19c3b5fe-8bde-4add-82b7-91e8044a53d9 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.686038] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-19c3b5fe-8bde-4add-82b7-91e8044a53d9" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.686038] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-19c3b5fe-8bde-4add-82b7-91e8044a53d9" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.687035] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-19c3b5fe-8bde-4add-82b7-91e8044a53d9" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.687963] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19c3b5fe-8bde-4add-82b7-91e8044a53d9',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.702963] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.702963] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.702963] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.702963] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.702963] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.702963] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.702963] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.702963] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.702963] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.702963] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.702963] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 327db6cf-92fa-437c-b166-c5060f6230e2 already deleted. [ 812.702963] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-327db6cf-92fa-437c-b166-c5060f6230e2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.191178] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.192136] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.192136] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.192136] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.192136] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.192264] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 19c3b5fe-8bde-4add-82b7-91e8044a53d9 not found, creating... [ 813.192466] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.192642] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.192756] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.192971] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.193128] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.193409] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.193679] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.193679] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.193885] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.195026] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.195026] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 19c3b5fe-8bde-4add-82b7-91e8044a53d9 is going to be created. [ 813.219372] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.219729] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.219729] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.220351] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.220525] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.220686] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-19c3b5fe-8bde-4add-82b7-91e8044a53d9" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.118902] env[70614]: INFO networking_nsxv3.common.synchronization [req-9acac3f2-43f6-4b48-9f39-b16863b3777a req-bc10446a-e685-425f-8f7e-497a66648813 service nova] Enqueued Resource ID: 327db6cf-92fa-437c-b166-c5060f6230e2 with Priority: HIGHEST for action security_group_rules [ 814.118902] env[70614]: INFO networking_nsxv3.common.synchronization [req-9acac3f2-43f6-4b48-9f39-b16863b3777a req-bc10446a-e685-425f-8f7e-497a66648813 service nova] Enqueued Resource ID: 327db6cf-92fa-437c-b166-c5060f6230e2 with Priority: HIGHEST for action security_group_members [ 814.118902] env[70614]: INFO networking_nsxv3.common.synchronization [req-9acac3f2-43f6-4b48-9f39-b16863b3777a req-bc10446a-e685-425f-8f7e-497a66648813 service nova] Enqueued Resource ID: 19c3b5fe-8bde-4add-82b7-91e8044a53d9 with Priority: HIGHEST for action port [ 814.118902] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 327db6cf-92fa-437c-b166-c5060f6230e2 with Priority: HIGHEST for action security_group_rules [ 814.118902] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 327db6cf-92fa-437c-b166-c5060f6230e2 with Priority: HIGHEST for action security_group_members [ 814.118902] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19c3b5fe-8bde-4add-82b7-91e8044a53d9 with Priority: HIGHEST for action port [ 814.118902] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-327db6cf-92fa-437c-b166-c5060f6230e2 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.118902] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-327db6cf-92fa-437c-b166-c5060f6230e2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.118902] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-327db6cf-92fa-437c-b166-c5060f6230e2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.121957] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-327db6cf-92fa-437c-b166-c5060f6230e2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.122327] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('327db6cf-92fa-437c-b166-c5060f6230e2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.124716] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-327db6cf-92fa-437c-b166-c5060f6230e2 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.124716] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-327db6cf-92fa-437c-b166-c5060f6230e2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.124716] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-327db6cf-92fa-437c-b166-c5060f6230e2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.124716] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-327db6cf-92fa-437c-b166-c5060f6230e2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.124716] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.128175] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.128366] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.131029] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.131029] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.131029] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('327db6cf-92fa-437c-b166-c5060f6230e2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.131029] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-19c3b5fe-8bde-4add-82b7-91e8044a53d9 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.131029] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-19c3b5fe-8bde-4add-82b7-91e8044a53d9" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.131029] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-19c3b5fe-8bde-4add-82b7-91e8044a53d9" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.131029] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-19c3b5fe-8bde-4add-82b7-91e8044a53d9" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.131029] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19c3b5fe-8bde-4add-82b7-91e8044a53d9',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.634450] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-327db6cf-92fa-437c-b166-c5060f6230e2 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.634754] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-327db6cf-92fa-437c-b166-c5060f6230e2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.634832] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('327db6cf-92fa-437c-b166-c5060f6230e2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.636323] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 19c3b5fe-8bde-4add-82b7-91e8044a53d9 with status ACTIVE [ 814.636323] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.636323] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.636323] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.636571] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.636571] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.636706] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.636817] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.636855] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.636993] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.637090] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.637281] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.637378] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.637439] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.637594] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.637682] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.637796] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 19c3b5fe-8bde-4add-82b7-91e8044a53d9 is going to be updated. [ 814.660110] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.660346] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.660438] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.660656] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.660803] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.660955] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-19c3b5fe-8bde-4add-82b7-91e8044a53d9" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.139784] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('327db6cf-92fa-437c-b166-c5060f6230e2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.254517] env[70614]: INFO networking_nsxv3.common.synchronization [req-0c96e3b2-d30b-4096-8749-537f951c956c req-075d8f94-dc30-4356-a70f-580f9b8d975f tempest-ServerDiagnosticsNegativeTest-1572490138 tempest-ServerDiagnosticsNegativeTest-1572490138-project-member] Enqueued Resource ID: ecaff113-395f-46a3-b8a5-a3ce5cb003a5 with Priority: HIGHEST for action security_group_members [ 815.255072] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ecaff113-395f-46a3-b8a5-a3ce5cb003a5 with Priority: HIGHEST for action security_group_members [ 815.255366] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-ecaff113-395f-46a3-b8a5-a3ce5cb003a5 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.255484] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ecaff113-395f-46a3-b8a5-a3ce5cb003a5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.255552] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ecaff113-395f-46a3-b8a5-a3ce5cb003a5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.255749] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ecaff113-395f-46a3-b8a5-a3ce5cb003a5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.255925] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.260113] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.260262] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.260525] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.260658] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.260806] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ecaff113-395f-46a3-b8a5-a3ce5cb003a5',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.645697] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.646103] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.646103] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.646179] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.646245] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.646336] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 327db6cf-92fa-437c-b166-c5060f6230e2 is going to be created. [ 815.670684] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.670826] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.670896] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.671117] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.671295] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.681291] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 327db6cf-92fa-437c-b166-c5060f6230e2 in Status: UNINITIALIZED for 2s [ 815.716568] env[70614]: INFO networking_nsxv3.common.synchronization [req-59bcdfe4-99f9-44a8-9e04-b07254c6d756 req-4a3523df-043c-4365-8fa7-74878234d2e3 tempest-FloatingIPsAssociationNegativeTestJSON-663480402 tempest-FloatingIPsAssociationNegativeTestJSON-663480402-project-member] Enqueued Resource ID: 2db7d87e-43a6-451c-9080-385c174466ee with Priority: HIGHEST for action security_group_members [ 815.717194] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2db7d87e-43a6-451c-9080-385c174466ee with Priority: HIGHEST for action security_group_members [ 815.717486] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-2db7d87e-43a6-451c-9080-385c174466ee taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.717609] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2db7d87e-43a6-451c-9080-385c174466ee" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.717677] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2db7d87e-43a6-451c-9080-385c174466ee" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.718693] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2db7d87e-43a6-451c-9080-385c174466ee" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.718693] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.719462] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.719462] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.719462] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.719462] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.719577] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2db7d87e-43a6-451c-9080-385c174466ee',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.764363] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.764532] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.764591] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.764794] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.764888] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.765097] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.765197] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.765249] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.765399] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.765467] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.765582] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ecaff113-395f-46a3-b8a5-a3ce5cb003a5 is going to be updated. [ 815.797141] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.797327] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.797365] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.797611] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.797692] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.807651] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ecaff113-395f-46a3-b8a5-a3ce5cb003a5 in Status: IN_PROGRESS for 2s [ 816.128025] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-305 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.128522] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-305" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.129177] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-305" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.129602] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-305" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.130204] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.130563] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.132016] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.132016] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.132016] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.132016] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 816.132016] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 816.132016] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 816.132016] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 816.132016] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 816.132016] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 816.132943] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 816.157020] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 816.157020] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 816.157020] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 816.157020] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-305" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.157020] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-f8962944-09ba-42b6-ac5b-c3971c569b72 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.157020] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-f8962944-09ba-42b6-ac5b-c3971c569b72" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.157020] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-f8962944-09ba-42b6-ac5b-c3971c569b72" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.157020] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-f8962944-09ba-42b6-ac5b-c3971c569b72" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.157020] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8962944-09ba-42b6-ac5b-c3971c569b72',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.226458] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.226458] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.226458] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.226458] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.226458] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.226458] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.226458] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.226458] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.226458] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.226458] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.226458] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2db7d87e-43a6-451c-9080-385c174466ee already deleted. [ 816.226458] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2db7d87e-43a6-451c-9080-385c174466ee" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.660536] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.660536] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.661369] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.661369] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.661369] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.661369] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port f8962944-09ba-42b6-ac5b-c3971c569b72 not found, creating... [ 816.662250] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.662250] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.662250] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.662250] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.663288] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.663462] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.663756] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.663756] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.663965] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.664124] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.664254] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: f8962944-09ba-42b6-ac5b-c3971c569b72 is going to be created. [ 816.686628] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.686911] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.687024] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.687447] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.687525] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.687738] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-f8962944-09ba-42b6-ac5b-c3971c569b72" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.449221] env[70614]: INFO networking_nsxv3.common.synchronization [req-59bcdfe4-99f9-44a8-9e04-b07254c6d756 req-165e6ed4-b43f-4f20-80e0-0742efe89728 service nova] Enqueued Resource ID: 2db7d87e-43a6-451c-9080-385c174466ee with Priority: HIGHEST for action security_group_rules [ 817.449323] env[70614]: INFO networking_nsxv3.common.synchronization [req-59bcdfe4-99f9-44a8-9e04-b07254c6d756 req-165e6ed4-b43f-4f20-80e0-0742efe89728 service nova] Enqueued Resource ID: 2db7d87e-43a6-451c-9080-385c174466ee with Priority: HIGHEST for action security_group_members [ 817.449616] env[70614]: INFO networking_nsxv3.common.synchronization [req-59bcdfe4-99f9-44a8-9e04-b07254c6d756 req-165e6ed4-b43f-4f20-80e0-0742efe89728 service nova] Enqueued Resource ID: f8962944-09ba-42b6-ac5b-c3971c569b72 with Priority: HIGHEST for action port [ 817.449828] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2db7d87e-43a6-451c-9080-385c174466ee with Priority: HIGHEST for action security_group_rules [ 817.449828] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2db7d87e-43a6-451c-9080-385c174466ee with Priority: HIGHEST for action security_group_members [ 817.451547] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8962944-09ba-42b6-ac5b-c3971c569b72 with Priority: HIGHEST for action port [ 817.451547] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2db7d87e-43a6-451c-9080-385c174466ee taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.451547] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2db7d87e-43a6-451c-9080-385c174466ee" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.451547] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2db7d87e-43a6-451c-9080-385c174466ee" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.451547] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2db7d87e-43a6-451c-9080-385c174466ee" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.451744] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2db7d87e-43a6-451c-9080-385c174466ee',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.452412] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-2db7d87e-43a6-451c-9080-385c174466ee taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.452563] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2db7d87e-43a6-451c-9080-385c174466ee" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.452655] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2db7d87e-43a6-451c-9080-385c174466ee" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.452828] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2db7d87e-43a6-451c-9080-385c174466ee" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.452969] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.453074] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.453134] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.453268] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.453349] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.453493] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2db7d87e-43a6-451c-9080-385c174466ee',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.454964] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-f8962944-09ba-42b6-ac5b-c3971c569b72 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.454964] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f8962944-09ba-42b6-ac5b-c3971c569b72" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.454964] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f8962944-09ba-42b6-ac5b-c3971c569b72" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.454964] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f8962944-09ba-42b6-ac5b-c3971c569b72" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.454964] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8962944-09ba-42b6-ac5b-c3971c569b72',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.693411] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 327db6cf-92fa-437c-b166-c5060f6230e2 in Status: SUCCESS [ 817.695283] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-327db6cf-92fa-437c-b166-c5060f6230e2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.695283] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-327db6cf-92fa-437c-b166-c5060f6230e2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.695283] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-327db6cf-92fa-437c-b166-c5060f6230e2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.695283] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.695283] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.695283] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.695822] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.695929] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.696024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-327db6cf-92fa-437c-b166-c5060f6230e2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.698031] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('327db6cf-92fa-437c-b166-c5060f6230e2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.821626] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ecaff113-395f-46a3-b8a5-a3ce5cb003a5 in Status: SUCCESS [ 817.821845] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ecaff113-395f-46a3-b8a5-a3ce5cb003a5 deletion is rescheduled due to dependency. [ 817.821964] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ecaff113-395f-46a3-b8a5-a3ce5cb003a5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.957387] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2db7d87e-43a6-451c-9080-385c174466ee',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.957538] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-2db7d87e-43a6-451c-9080-385c174466ee taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.957668] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2db7d87e-43a6-451c-9080-385c174466ee" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.957896] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f8962944-09ba-42b6-ac5b-c3971c569b72 with status ACTIVE [ 817.958073] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.958184] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.958250] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.958592] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.958688] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.958888] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.959080] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.959164] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.959332] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.959411] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.959620] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.963025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.963025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.963025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.963025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.963025] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f8962944-09ba-42b6-ac5b-c3971c569b72 is going to be updated. [ 817.983528] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.983725] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.983725] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.983982] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.984082] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.984275] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f8962944-09ba-42b6-ac5b-c3971c569b72" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.198786] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-327db6cf-92fa-437c-b166-c5060f6230e2 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.198955] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-327db6cf-92fa-437c-b166-c5060f6230e2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.199017] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-327db6cf-92fa-437c-b166-c5060f6230e2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.199210] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-327db6cf-92fa-437c-b166-c5060f6230e2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.199378] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.199481] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.199544] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.199697] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.199800] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.199886] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-327db6cf-92fa-437c-b166-c5060f6230e2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.200044] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-327db6cf-92fa-437c-b166-c5060f6230e2 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.200161] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-327db6cf-92fa-437c-b166-c5060f6230e2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.200221] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-327db6cf-92fa-437c-b166-c5060f6230e2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.200457] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-327db6cf-92fa-437c-b166-c5060f6230e2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.200629] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.200741] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.200801] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.201180] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.201180] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.201314] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-327db6cf-92fa-437c-b166-c5060f6230e2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.201314] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('327db6cf-92fa-437c-b166-c5060f6230e2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.463628] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2db7d87e-43a6-451c-9080-385c174466ee',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.538043] env[70614]: INFO networking_nsxv3.common.synchronization [req-d32fc596-92cd-4c1a-b41c-6858025b5fa5 req-954970a5-151f-4709-9ae4-bc6f62277273 tempest-ServerActionsTestOtherB-1079543702 tempest-ServerActionsTestOtherB-1079543702-project-member] Enqueued Resource ID: 4e54f39e-349d-49ad-bb07-348488d846f0 with Priority: HIGHEST for action security_group_members [ 818.538327] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e54f39e-349d-49ad-bb07-348488d846f0 with Priority: HIGHEST for action security_group_members [ 818.538622] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e54f39e-349d-49ad-bb07-348488d846f0 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.538745] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.538903] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.539247] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.539994] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.540145] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.540215] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.540382] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.540552] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.540677] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e54f39e-349d-49ad-bb07-348488d846f0',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.706016] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 327db6cf-92fa-437c-b166-c5060f6230e2: rpc.has_security_group_logging(os_id): False [ 818.726291] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.726383] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.726417] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.727034] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.727034] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.727034] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.727196] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.727196] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.727311] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.727391] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.727618] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.727730] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.727834] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.727974] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.729810] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.730283] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.730580] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.730580] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.732109] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.732109] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.732109] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 327db6cf-92fa-437c-b166-c5060f6230e2 is going to be created. [ 818.793965] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.794150] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.794225] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.794434] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.794623] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.808483] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 327db6cf-92fa-437c-b166-c5060f6230e2 in Status: IN_PROGRESS for 2s [ 818.969692] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.969998] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.969998] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.970211] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.970305] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.970410] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2db7d87e-43a6-451c-9080-385c174466ee is going to be created. [ 818.999801] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.000169] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.000169] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.000243] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.000385] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.006514] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-883 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.006514] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-883" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.006514] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-883" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.006514] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-883" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.006514] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.006514] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.006927] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.006927] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.006992] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.007246] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 819.007353] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 819.007473] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 819.007592] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 819.007710] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 819.007910] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 819.009029] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 819.010987] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2db7d87e-43a6-451c-9080-385c174466ee in Status: UNINITIALIZED for 2s [ 819.031521] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 819.031689] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 819.031828] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 819.032018] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-883" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.032339] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-00713a73-cdfd-4605-99ca-c0c83a80532f taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.032514] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-00713a73-cdfd-4605-99ca-c0c83a80532f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.032633] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-00713a73-cdfd-4605-99ca-c0c83a80532f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.032969] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-00713a73-cdfd-4605-99ca-c0c83a80532f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.033125] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('00713a73-cdfd-4605-99ca-c0c83a80532f',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.044917] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.045133] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.045196] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.045435] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.045537] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.045865] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.046014] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.046105] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.046273] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.046391] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.046491] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e54f39e-349d-49ad-bb07-348488d846f0 already deleted. [ 819.046577] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.537285] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.537285] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.537285] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.537285] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.537285] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.537511] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 00713a73-cdfd-4605-99ca-c0c83a80532f not found, creating... [ 819.537720] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.537866] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.537906] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.538237] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.538397] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.538697] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.538865] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.538972] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.539628] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.539789] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.539941] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 00713a73-cdfd-4605-99ca-c0c83a80532f is going to be created. [ 819.568387] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.568668] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.568793] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.569138] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.569382] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.569866] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-00713a73-cdfd-4605-99ca-c0c83a80532f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.823561] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 327db6cf-92fa-437c-b166-c5060f6230e2 in Status: SUCCESS [ 820.823963] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-327db6cf-92fa-437c-b166-c5060f6230e2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.024936] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2db7d87e-43a6-451c-9080-385c174466ee in Status: SUCCESS [ 821.025271] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2db7d87e-43a6-451c-9080-385c174466ee" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.025596] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2db7d87e-43a6-451c-9080-385c174466ee" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.025780] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2db7d87e-43a6-451c-9080-385c174466ee" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.026209] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.026209] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.026332] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.026629] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.026724] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.026844] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2db7d87e-43a6-451c-9080-385c174466ee" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.026961] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2db7d87e-43a6-451c-9080-385c174466ee',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.081496] env[70614]: INFO networking_nsxv3.common.synchronization [req-d32fc596-92cd-4c1a-b41c-6858025b5fa5 req-323c144d-d67b-4e75-b0fe-1610ec0217e7 service nova] Enqueued Resource ID: 4e54f39e-349d-49ad-bb07-348488d846f0 with Priority: HIGHEST for action security_group_rules [ 821.081833] env[70614]: INFO networking_nsxv3.common.synchronization [req-d32fc596-92cd-4c1a-b41c-6858025b5fa5 req-323c144d-d67b-4e75-b0fe-1610ec0217e7 service nova] Enqueued Resource ID: 4e54f39e-349d-49ad-bb07-348488d846f0 with Priority: HIGHEST for action security_group_members [ 821.082088] env[70614]: INFO networking_nsxv3.common.synchronization [req-d32fc596-92cd-4c1a-b41c-6858025b5fa5 req-323c144d-d67b-4e75-b0fe-1610ec0217e7 service nova] Enqueued Resource ID: 00713a73-cdfd-4605-99ca-c0c83a80532f with Priority: HIGHEST for action port [ 821.083251] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e54f39e-349d-49ad-bb07-348488d846f0 with Priority: HIGHEST for action security_group_rules [ 821.083251] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e54f39e-349d-49ad-bb07-348488d846f0 with Priority: HIGHEST for action security_group_members [ 821.083251] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00713a73-cdfd-4605-99ca-c0c83a80532f with Priority: HIGHEST for action port [ 821.088155] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e54f39e-349d-49ad-bb07-348488d846f0 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.088155] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.088155] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.088155] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.088155] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e54f39e-349d-49ad-bb07-348488d846f0',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.088155] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e54f39e-349d-49ad-bb07-348488d846f0 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.088155] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.088155] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.088155] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.088155] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.088155] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.088155] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.088155] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.088155] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.088155] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e54f39e-349d-49ad-bb07-348488d846f0',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.092089] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-00713a73-cdfd-4605-99ca-c0c83a80532f taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.092089] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-00713a73-cdfd-4605-99ca-c0c83a80532f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.092089] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-00713a73-cdfd-4605-99ca-c0c83a80532f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.093895] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-00713a73-cdfd-4605-99ca-c0c83a80532f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.093895] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('00713a73-cdfd-4605-99ca-c0c83a80532f',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.380316] env[70614]: INFO networking_nsxv3.common.synchronization [req-f5f3fe57-5150-41ae-8c7e-09f35be1f613 req-a3264a44-9703-4741-b128-7c3a63591191 tempest-ServerMetadataNegativeTestJSON-1965133638 tempest-ServerMetadataNegativeTestJSON-1965133638-project-member] Enqueued Resource ID: 6b7b9850-41ce-4284-a095-b60375661eb1 with Priority: HIGHEST for action security_group_members [ 821.381109] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b7b9850-41ce-4284-a095-b60375661eb1 with Priority: HIGHEST for action security_group_members [ 821.381811] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b7b9850-41ce-4284-a095-b60375661eb1 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.381811] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b7b9850-41ce-4284-a095-b60375661eb1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.381811] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b7b9850-41ce-4284-a095-b60375661eb1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.381991] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b7b9850-41ce-4284-a095-b60375661eb1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.382516] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.382698] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.382792] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.383015] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.383155] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.383359] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b7b9850-41ce-4284-a095-b60375661eb1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.529124] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-2db7d87e-43a6-451c-9080-385c174466ee taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.529272] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2db7d87e-43a6-451c-9080-385c174466ee" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.529342] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2db7d87e-43a6-451c-9080-385c174466ee" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.529544] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2db7d87e-43a6-451c-9080-385c174466ee" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.529701] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.529836] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.529872] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.530018] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.530131] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.530248] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2db7d87e-43a6-451c-9080-385c174466ee" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.530415] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-2db7d87e-43a6-451c-9080-385c174466ee taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.530507] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2db7d87e-43a6-451c-9080-385c174466ee" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.530564] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2db7d87e-43a6-451c-9080-385c174466ee" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.530733] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2db7d87e-43a6-451c-9080-385c174466ee" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.531238] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.531333] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.531393] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.531535] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.531787] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.531787] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2db7d87e-43a6-451c-9080-385c174466ee" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.531787] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2db7d87e-43a6-451c-9080-385c174466ee',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.595251] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4e54f39e-349d-49ad-bb07-348488d846f0',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.596575] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e54f39e-349d-49ad-bb07-348488d846f0 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.596575] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.596747] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 00713a73-cdfd-4605-99ca-c0c83a80532f with status ACTIVE [ 821.596840] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.596955] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.597028] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.597235] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.597319] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.597480] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.597579] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.597638] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.597820] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.597893] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.600394] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.600500] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.600577] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.600744] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.600823] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.600916] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 00713a73-cdfd-4605-99ca-c0c83a80532f is going to be updated. [ 821.625973] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.625973] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.625973] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.625973] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.625973] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.626393] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-00713a73-cdfd-4605-99ca-c0c83a80532f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.886708] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.887048] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.887048] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.887392] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.887469] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.887701] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.887817] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.887884] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.888062] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.888142] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.888229] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b7b9850-41ce-4284-a095-b60375661eb1 already deleted. [ 821.888371] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b7b9850-41ce-4284-a095-b60375661eb1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.931549] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-555 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.931549] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-555" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.931724] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-555" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.932905] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-555" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.932905] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.932905] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.932905] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.933302] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.933302] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.933568] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 821.933745] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 821.933892] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 821.934077] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 821.934077] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 821.934374] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 821.934374] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 821.958218] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 821.958218] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 821.958218] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 821.958423] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-555" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.958848] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-afdc6800-482d-418e-9a6d-587299419b4b taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.959252] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-afdc6800-482d-418e-9a6d-587299419b4b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.959252] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-afdc6800-482d-418e-9a6d-587299419b4b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.959580] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-afdc6800-482d-418e-9a6d-587299419b4b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.959743] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('afdc6800-482d-418e-9a6d-587299419b4b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.037406] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2db7d87e-43a6-451c-9080-385c174466ee: rpc.has_security_group_logging(os_id): False [ 822.054707] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.056678] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.057037] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.057037] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.057152] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.057331] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.057453] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.057516] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.057680] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.057761] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.058096] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.058749] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.058847] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.059049] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.059170] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.059510] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.059645] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.059719] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.059996] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.060092] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.060280] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2db7d87e-43a6-451c-9080-385c174466ee is going to be created. [ 822.103132] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4e54f39e-349d-49ad-bb07-348488d846f0',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.122609] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.122749] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.122879] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.123140] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.123319] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.136395] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2db7d87e-43a6-451c-9080-385c174466ee in Status: IN_PROGRESS for 2s [ 822.465812] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.468645] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.468911] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.469436] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.470412] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.470746] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port afdc6800-482d-418e-9a6d-587299419b4b not found, creating... [ 822.471375] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.471698] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.472367] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.472367] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.472570] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.472915] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.473321] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.473321] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.474651] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.474948] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.475057] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: afdc6800-482d-418e-9a6d-587299419b4b is going to be created. [ 822.503045] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.503045] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.503045] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.503045] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.503045] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.503045] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-afdc6800-482d-418e-9a6d-587299419b4b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.562277] env[70614]: INFO networking_nsxv3.common.synchronization [req-6a4f1990-d726-403c-9e34-5f33fb2f108f req-52b669b9-b1f0-4319-b0e1-25d7c151197b tempest-ImagesTestJSON-1765947257 tempest-ImagesTestJSON-1765947257-project-member] Enqueued Resource ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 with Priority: HIGHEST for action security_group_members [ 822.562876] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 with Priority: HIGHEST for action security_group_members [ 822.563668] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-04a082fe-52f7-4ac6-a12b-63791c63be86 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.563827] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.564009] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.564168] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.564359] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.564482] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.564567] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.564724] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.564831] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.566108] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04a082fe-52f7-4ac6-a12b-63791c63be86',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.605991] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.606252] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.606331] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.606666] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.606798] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.606908] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e54f39e-349d-49ad-bb07-348488d846f0 is going to be created. [ 822.645090] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.645090] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.645090] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.645090] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.645090] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.657556] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e54f39e-349d-49ad-bb07-348488d846f0 in Status: UNINITIALIZED for 2s [ 823.067304] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.067617] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.067617] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.067767] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.067879] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.068097] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.068216] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.068269] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.068398] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.068474] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.068560] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 is going to be updated. [ 823.101635] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.101769] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.101839] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.102068] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.102211] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.118837] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 in Status: IN_PROGRESS for 2s [ 823.578246] env[70614]: INFO networking_nsxv3.common.synchronization [req-f5f3fe57-5150-41ae-8c7e-09f35be1f613 req-7598c204-c5b3-4c6f-9c5c-758cf4c0485e service nova] Enqueued Resource ID: 6b7b9850-41ce-4284-a095-b60375661eb1 with Priority: HIGHEST for action security_group_rules [ 823.578338] env[70614]: INFO networking_nsxv3.common.synchronization [req-f5f3fe57-5150-41ae-8c7e-09f35be1f613 req-7598c204-c5b3-4c6f-9c5c-758cf4c0485e service nova] Enqueued Resource ID: 6b7b9850-41ce-4284-a095-b60375661eb1 with Priority: HIGHEST for action security_group_members [ 823.578510] env[70614]: INFO networking_nsxv3.common.synchronization [req-f5f3fe57-5150-41ae-8c7e-09f35be1f613 req-7598c204-c5b3-4c6f-9c5c-758cf4c0485e service nova] Enqueued Resource ID: afdc6800-482d-418e-9a6d-587299419b4b with Priority: HIGHEST for action port [ 823.583087] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b7b9850-41ce-4284-a095-b60375661eb1 with Priority: HIGHEST for action security_group_rules [ 823.583305] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b7b9850-41ce-4284-a095-b60375661eb1 with Priority: HIGHEST for action security_group_members [ 823.583419] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afdc6800-482d-418e-9a6d-587299419b4b with Priority: HIGHEST for action port [ 823.584077] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b7b9850-41ce-4284-a095-b60375661eb1 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.584216] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b7b9850-41ce-4284-a095-b60375661eb1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.584282] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b7b9850-41ce-4284-a095-b60375661eb1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.584548] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b7b9850-41ce-4284-a095-b60375661eb1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.584637] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b7b9850-41ce-4284-a095-b60375661eb1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.586429] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b7b9850-41ce-4284-a095-b60375661eb1 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.589374] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b7b9850-41ce-4284-a095-b60375661eb1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.589482] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b7b9850-41ce-4284-a095-b60375661eb1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.589706] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b7b9850-41ce-4284-a095-b60375661eb1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.589924] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.590114] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.590114] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.591390] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.591390] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.591390] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b7b9850-41ce-4284-a095-b60375661eb1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.591984] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-afdc6800-482d-418e-9a6d-587299419b4b taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.592104] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-afdc6800-482d-418e-9a6d-587299419b4b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.592175] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-afdc6800-482d-418e-9a6d-587299419b4b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.592339] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-afdc6800-482d-418e-9a6d-587299419b4b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.592417] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('afdc6800-482d-418e-9a6d-587299419b4b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.087320] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b7b9850-41ce-4284-a095-b60375661eb1 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.087320] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b7b9850-41ce-4284-a095-b60375661eb1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.094983] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6b7b9850-41ce-4284-a095-b60375661eb1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.096092] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port afdc6800-482d-418e-9a6d-587299419b4b with status ACTIVE [ 824.096384] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.096628] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.096628] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.096909] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.097069] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.097487] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.097487] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.097487] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.098044] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.098044] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.098044] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.098044] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.098225] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.098225] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.098315] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.098365] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: afdc6800-482d-418e-9a6d-587299419b4b is going to be updated. [ 824.132204] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.132693] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.132693] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.132693] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.132913] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.134117] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-afdc6800-482d-418e-9a6d-587299419b4b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.149770] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2db7d87e-43a6-451c-9080-385c174466ee in Status: SUCCESS [ 824.150032] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2db7d87e-43a6-451c-9080-385c174466ee" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.604027] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6b7b9850-41ce-4284-a095-b60375661eb1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.668970] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e54f39e-349d-49ad-bb07-348488d846f0 in Status: SUCCESS [ 824.669541] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.669541] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.669655] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.669937] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.670036] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.670084] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.670570] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.670570] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.670570] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.670570] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4e54f39e-349d-49ad-bb07-348488d846f0',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.767945] env[70614]: INFO networking_nsxv3.common.synchronization [req-f3c1db38-cf75-4898-9973-493b40074f5c req-8d79660c-3b8a-4ce3-aaa3-22a80c961df4 tempest-SecurityGroupsTestJSON-818479832 tempest-SecurityGroupsTestJSON-818479832-project-member] Enqueued Resource ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 with Priority: HIGHEST for action security_group_members [ 824.771698] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 with Priority: HIGHEST for action security_group_members [ 824.772219] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.772405] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.772501] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.772829] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.772938] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.773037] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.773037] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.773363] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.773455] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.773573] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1440acfc-c5d6-4a44-b0a8-654c4f16a7d1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.917333] env[70614]: INFO networking_nsxv3.common.synchronization [None req-8fb12b9c-eb1b-4b39-82a6-9a112990d3cd None None] Enqueued Resource ID: 07cdb6db-5f87-49c3-a6bd-c88658c77740 with Priority: HIGHEST for action port [ 824.917333] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07cdb6db-5f87-49c3-a6bd-c88658c77740 with Priority: HIGHEST for action port [ 824.917946] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-07cdb6db-5f87-49c3-a6bd-c88658c77740 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.918127] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-07cdb6db-5f87-49c3-a6bd-c88658c77740" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.918188] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-07cdb6db-5f87-49c3-a6bd-c88658c77740" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.918787] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-07cdb6db-5f87-49c3-a6bd-c88658c77740" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.919052] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07cdb6db-5f87-49c3-a6bd-c88658c77740',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.025642] env[70614]: INFO networking_nsxv3.common.synchronization [req-e081873a-6800-421d-84d5-abba29221fd1 req-4f97591e-8835-4011-ba07-bda1424a1654 tempest-ListImageFiltersTestJSON-737813167 tempest-ListImageFiltersTestJSON-737813167-project-member] Enqueued Resource ID: f21a3b6e-da5e-4c92-8717-c114952a5767 with Priority: HIGHEST for action security_group_members [ 825.026423] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f21a3b6e-da5e-4c92-8717-c114952a5767 with Priority: HIGHEST for action security_group_members [ 825.026775] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-f21a3b6e-da5e-4c92-8717-c114952a5767 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.026905] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f21a3b6e-da5e-4c92-8717-c114952a5767" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.026983] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f21a3b6e-da5e-4c92-8717-c114952a5767" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.028386] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f21a3b6e-da5e-4c92-8717-c114952a5767" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.028657] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.028740] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.028778] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.028989] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.029063] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.029465] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f21a3b6e-da5e-4c92-8717-c114952a5767',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.108350] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.108665] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.108665] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.109188] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.109188] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.109188] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b7b9850-41ce-4284-a095-b60375661eb1 is going to be created. [ 825.128069] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 in Status: SUCCESS [ 825.128295] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 deletion is rescheduled due to dependency. [ 825.128423] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.137886] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.138119] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.138201] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.138450] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.138975] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.149731] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b7b9850-41ce-4284-a095-b60375661eb1 in Status: UNINITIALIZED for 2s [ 825.175506] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4e54f39e-349d-49ad-bb07-348488d846f0',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.278409] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1440acfc-c5d6-4a44-b0a8-654c4f16a7d1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.422963] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 07cdb6db-5f87-49c3-a6bd-c88658c77740 [ 825.422963] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.422963] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.422963] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.422963] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.422963] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.422963] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:07cdb6db-5f87-49c3-a6bd-c88658c77740 already deleted. [ 825.422963] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-07cdb6db-5f87-49c3-a6bd-c88658c77740" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.536446] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.536446] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.536446] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.536446] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.536446] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.536446] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.536446] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.536446] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.536446] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.536446] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.536446] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f21a3b6e-da5e-4c92-8717-c114952a5767 is going to be updated. [ 825.566764] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.567478] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.567478] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.567631] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.567785] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.577683] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f21a3b6e-da5e-4c92-8717-c114952a5767 in Status: IN_PROGRESS for 2s [ 825.677619] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4e54f39e-349d-49ad-bb07-348488d846f0: rpc.has_security_group_logging(os_id): False [ 825.697612] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.697768] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.697942] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.698138] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.698248] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.698497] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.698597] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.698673] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.698821] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.698896] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.699016] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e54f39e-349d-49ad-bb07-348488d846f0 is going to be created. [ 825.764767] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.764767] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.764767] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.764767] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.764767] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.772797] env[70614]: INFO networking_nsxv3.common.synchronization [req-e269de60-1d79-4758-8ac4-86d96efe7314 req-59cb91a3-9c0e-4fd7-853f-331b642eaea5 tempest-ServerAddressesNegativeTestJSON-538390798 tempest-ServerAddressesNegativeTestJSON-538390798-project-member] Enqueued Resource ID: 327db6cf-92fa-437c-b166-c5060f6230e2 with Priority: HIGHEST for action security_group_members [ 825.773419] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 327db6cf-92fa-437c-b166-c5060f6230e2 with Priority: HIGHEST for action security_group_members [ 825.773726] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-327db6cf-92fa-437c-b166-c5060f6230e2 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.773851] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-327db6cf-92fa-437c-b166-c5060f6230e2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.773943] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-327db6cf-92fa-437c-b166-c5060f6230e2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.774189] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-327db6cf-92fa-437c-b166-c5060f6230e2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.774356] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.774577] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.774649] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.774806] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.774895] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.774995] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('327db6cf-92fa-437c-b166-c5060f6230e2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.784351] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1440acfc-c5d6-4a44-b0a8-654c4f16a7d1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.785575] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e54f39e-349d-49ad-bb07-348488d846f0 in Status: IN_PROGRESS for 2s [ 825.964221] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-28 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.965230] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-28" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.965230] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-28" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.965230] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-28" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.965376] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.965446] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.965538] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.965762] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.965914] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.966459] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 825.966725] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 825.967258] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 825.967258] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 825.967258] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 825.967258] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 825.967564] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 825.991938] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 825.991938] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 825.992160] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 825.992467] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-28" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.992852] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-a9be95c1-c975-4177-bf16-9cfdfa853375 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.993100] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-a9be95c1-c975-4177-bf16-9cfdfa853375" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.993349] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-a9be95c1-c975-4177-bf16-9cfdfa853375" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.997661] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-a9be95c1-c975-4177-bf16-9cfdfa853375" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.997853] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a9be95c1-c975-4177-bf16-9cfdfa853375',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.278267] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.278267] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.278267] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.279536] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.279536] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.279536] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.279742] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.279742] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.280184] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.280337] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.280445] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 327db6cf-92fa-437c-b166-c5060f6230e2 is going to be updated. [ 826.287282] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.287760] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.287760] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.288730] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.288963] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.289092] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 is going to be updated. [ 826.318278] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.318502] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.318502] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.318968] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.319227] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.321129] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.321282] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.321333] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.321606] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.321649] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.334094] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 327db6cf-92fa-437c-b166-c5060f6230e2 in Status: IN_PROGRESS for 2s [ 826.334920] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 in Status: IN_PROGRESS for 2s [ 826.502729] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.503174] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.503353] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.503760] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.504042] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.504311] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port a9be95c1-c975-4177-bf16-9cfdfa853375 not found, creating... [ 826.504768] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.505448] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.505780] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.506159] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.506396] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.506876] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.507229] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.507487] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.512024] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.512024] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.512024] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: a9be95c1-c975-4177-bf16-9cfdfa853375 is going to be created. [ 826.546204] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.548246] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.548480] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.548933] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.549230] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.549486] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-a9be95c1-c975-4177-bf16-9cfdfa853375" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.164105] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b7b9850-41ce-4284-a095-b60375661eb1 in Status: SUCCESS [ 827.164647] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b7b9850-41ce-4284-a095-b60375661eb1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.165395] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b7b9850-41ce-4284-a095-b60375661eb1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.165395] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b7b9850-41ce-4284-a095-b60375661eb1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.165395] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.165395] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.165395] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.165719] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.165763] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.165896] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b7b9850-41ce-4284-a095-b60375661eb1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.166071] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6b7b9850-41ce-4284-a095-b60375661eb1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.281292] env[70614]: INFO networking_nsxv3.common.synchronization [None req-659f7988-41db-4079-9757-5d81c987768f None None] Enqueued Resource ID: 972550ad-0ec3-4c21-867d-3bd37e131cf4 with Priority: HIGHEST for action port [ 827.281682] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 972550ad-0ec3-4c21-867d-3bd37e131cf4 with Priority: HIGHEST for action port [ 827.283697] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-972550ad-0ec3-4c21-867d-3bd37e131cf4 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.283822] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-972550ad-0ec3-4c21-867d-3bd37e131cf4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.284591] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-972550ad-0ec3-4c21-867d-3bd37e131cf4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.284591] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-972550ad-0ec3-4c21-867d-3bd37e131cf4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.284591] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('972550ad-0ec3-4c21-867d-3bd37e131cf4',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.592139] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f21a3b6e-da5e-4c92-8717-c114952a5767 in Status: SUCCESS [ 827.593491] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f21a3b6e-da5e-4c92-8717-c114952a5767 deletion is rescheduled due to dependency. [ 827.593634] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f21a3b6e-da5e-4c92-8717-c114952a5767" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.668446] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b7b9850-41ce-4284-a095-b60375661eb1 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.668592] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b7b9850-41ce-4284-a095-b60375661eb1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.668592] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b7b9850-41ce-4284-a095-b60375661eb1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.668829] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b7b9850-41ce-4284-a095-b60375661eb1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.668977] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.669114] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.669156] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.669383] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.669383] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.669473] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b7b9850-41ce-4284-a095-b60375661eb1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.669628] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b7b9850-41ce-4284-a095-b60375661eb1 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.669718] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b7b9850-41ce-4284-a095-b60375661eb1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.669776] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b7b9850-41ce-4284-a095-b60375661eb1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.669917] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b7b9850-41ce-4284-a095-b60375661eb1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.670065] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.670258] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.670258] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.670360] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.670411] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.670495] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b7b9850-41ce-4284-a095-b60375661eb1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.670590] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6b7b9850-41ce-4284-a095-b60375661eb1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.788119] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 972550ad-0ec3-4c21-867d-3bd37e131cf4 [ 827.788119] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.788340] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.788340] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.788435] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.788521] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.788611] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:972550ad-0ec3-4c21-867d-3bd37e131cf4 already deleted. [ 827.788686] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-972550ad-0ec3-4c21-867d-3bd37e131cf4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.800151] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e54f39e-349d-49ad-bb07-348488d846f0 in Status: SUCCESS [ 827.800390] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.829059] env[70614]: INFO networking_nsxv3.common.synchronization [req-f3c1db38-cf75-4898-9973-493b40074f5c req-bee428a6-f4b1-46ea-b87c-6529990baeb9 service nova] Enqueued Resource ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 with Priority: HIGHEST for action security_group_rules [ 827.829252] env[70614]: INFO networking_nsxv3.common.synchronization [req-f3c1db38-cf75-4898-9973-493b40074f5c req-bee428a6-f4b1-46ea-b87c-6529990baeb9 service nova] Enqueued Resource ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 with Priority: HIGHEST for action security_group_members [ 827.829386] env[70614]: INFO networking_nsxv3.common.synchronization [req-f3c1db38-cf75-4898-9973-493b40074f5c req-bee428a6-f4b1-46ea-b87c-6529990baeb9 service nova] Enqueued Resource ID: a9be95c1-c975-4177-bf16-9cfdfa853375 with Priority: HIGHEST for action port [ 827.829612] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 with Priority: HIGHEST for action security_group_rules [ 827.829733] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 with Priority: HIGHEST for action security_group_members [ 827.829826] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9be95c1-c975-4177-bf16-9cfdfa853375 with Priority: HIGHEST for action port [ 827.833199] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.833347] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.833437] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.833618] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.833698] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1440acfc-c5d6-4a44-b0a8-654c4f16a7d1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.835055] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.835175] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.835387] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-a9be95c1-c975-4177-bf16-9cfdfa853375 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.835514] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a9be95c1-c975-4177-bf16-9cfdfa853375" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.835558] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a9be95c1-c975-4177-bf16-9cfdfa853375" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.835766] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a9be95c1-c975-4177-bf16-9cfdfa853375" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.835803] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a9be95c1-c975-4177-bf16-9cfdfa853375',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.149691] env[70614]: INFO networking_nsxv3.common.synchronization [None req-05d2a4d8-bb12-403b-acd0-6a007f599e3d tempest-ServersV294TestFqdnHostnames-346829035 tempest-ServersV294TestFqdnHostnames-346829035-project-member] Enqueued Resource ID: 3f4770f9-9c1b-48b7-8d14-3089a02098e4 with Priority: HIGHEST for action security_group_rules [ 828.150343] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f4770f9-9c1b-48b7-8d14-3089a02098e4 with Priority: HIGHEST for action security_group_rules [ 828.150450] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3f4770f9-9c1b-48b7-8d14-3089a02098e4 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.150587] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3f4770f9-9c1b-48b7-8d14-3089a02098e4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.150621] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3f4770f9-9c1b-48b7-8d14-3089a02098e4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.150862] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3f4770f9-9c1b-48b7-8d14-3089a02098e4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.150946] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3f4770f9-9c1b-48b7-8d14-3089a02098e4',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.174048] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6b7b9850-41ce-4284-a095-b60375661eb1: rpc.has_security_group_logging(os_id): False [ 828.193544] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.194477] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.194601] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.195357] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.195567] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.195718] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.195848] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.195903] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.196453] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.196453] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.196453] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.196453] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.196630] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.196665] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.196713] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.196897] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.196992] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.197188] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.197340] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.197791] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.197910] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b7b9850-41ce-4284-a095-b60375661eb1 is going to be created. [ 828.227100] env[70614]: INFO networking_nsxv3.common.synchronization [req-7291913f-11ad-4c82-a2f7-29ff2d141b2f req-7378acc5-68be-4b0d-b529-24e816f7a088 tempest-ServerMetadataTestJSON-2044450732 tempest-ServerMetadataTestJSON-2044450732-project-member] Enqueued Resource ID: 8004bc6e-552e-4ff4-87f0-242b54bbfb5d with Priority: HIGHEST for action security_group_members [ 828.227170] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8004bc6e-552e-4ff4-87f0-242b54bbfb5d with Priority: HIGHEST for action security_group_members [ 828.227814] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-8004bc6e-552e-4ff4-87f0-242b54bbfb5d taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.228052] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8004bc6e-552e-4ff4-87f0-242b54bbfb5d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.228852] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8004bc6e-552e-4ff4-87f0-242b54bbfb5d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.228852] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8004bc6e-552e-4ff4-87f0-242b54bbfb5d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.228852] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.229061] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.229061] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.229246] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.229358] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.229462] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8004bc6e-552e-4ff4-87f0-242b54bbfb5d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.258950] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.259051] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.259125] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.259320] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.259497] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.274986] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b7b9850-41ce-4284-a095-b60375661eb1 in Status: IN_PROGRESS for 2s [ 828.325847] env[70614]: INFO networking_nsxv3.common.synchronization [None req-eb7ef516-f885-4495-bc70-0b87e7a86da8 tempest-ServersV294TestFqdnHostnames-346829035 tempest-ServersV294TestFqdnHostnames-346829035-project-member] Enqueued Resource ID: 3f4770f9-9c1b-48b7-8d14-3089a02098e4 with Priority: HIGHEST for action security_group_rules [ 828.326417] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f4770f9-9c1b-48b7-8d14-3089a02098e4 with Priority: HIGHEST for action security_group_rules [ 828.326667] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3f4770f9-9c1b-48b7-8d14-3089a02098e4 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.326763] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3f4770f9-9c1b-48b7-8d14-3089a02098e4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.337542] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.337542] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.339339] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a9be95c1-c975-4177-bf16-9cfdfa853375 with status ACTIVE [ 828.339642] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.342056] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.342056] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.342056] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.342056] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.342056] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.342056] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.342056] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.342056] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.342056] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.342056] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.342056] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.342056] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.342056] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.342056] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.342056] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a9be95c1-c975-4177-bf16-9cfdfa853375 is going to be updated. [ 828.355339] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 in Status: SUCCESS [ 828.355339] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.355339] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.355339] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.355339] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.355339] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.355339] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.355339] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.355339] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.355339] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1440acfc-c5d6-4a44-b0a8-654c4f16a7d1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.361430] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 327db6cf-92fa-437c-b166-c5060f6230e2 in Status: SUCCESS [ 828.361430] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 327db6cf-92fa-437c-b166-c5060f6230e2 deletion is rescheduled due to dependency. [ 828.361430] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-327db6cf-92fa-437c-b166-c5060f6230e2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.387470] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.387597] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.387706] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.387960] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.388109] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.388262] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a9be95c1-c975-4177-bf16-9cfdfa853375" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.675681] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.675681] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.675681] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.675681] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.675681] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.675681] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3f4770f9-9c1b-48b7-8d14-3089a02098e4 already deleted. [ 828.675681] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3f4770f9-9c1b-48b7-8d14-3089a02098e4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.675681] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3f4770f9-9c1b-48b7-8d14-3089a02098e4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.675681] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3f4770f9-9c1b-48b7-8d14-3089a02098e4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.675681] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3f4770f9-9c1b-48b7-8d14-3089a02098e4',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.732272] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.734488] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.734488] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.734488] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.734488] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.734488] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.734488] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.734488] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.734488] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.734488] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.734488] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8004bc6e-552e-4ff4-87f0-242b54bbfb5d already deleted. [ 828.734488] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8004bc6e-552e-4ff4-87f0-242b54bbfb5d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.861146] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1440acfc-c5d6-4a44-b0a8-654c4f16a7d1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.206916] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.207123] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.207251] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.207513] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.207639] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.207749] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3f4770f9-9c1b-48b7-8d14-3089a02098e4 already deleted. [ 829.207836] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3f4770f9-9c1b-48b7-8d14-3089a02098e4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.364512] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1440acfc-c5d6-4a44-b0a8-654c4f16a7d1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.864881] env[70614]: INFO networking_nsxv3.common.synchronization [req-560a321b-013a-4a05-9876-dbfae53f0f33 req-1e779b49-25b9-4a6d-8b35-130a28bd18bb tempest-ServerRescueTestJSON-1696153379 tempest-ServerRescueTestJSON-1696153379-project-member] Enqueued Resource ID: 0a55332f-b291-4614-8b34-ee4cd0d39027 with Priority: HIGHEST for action security_group_members [ 829.865839] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a55332f-b291-4614-8b34-ee4cd0d39027 with Priority: HIGHEST for action security_group_members [ 829.865839] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a55332f-b291-4614-8b34-ee4cd0d39027 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.866013] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.866013] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.867532] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.867532] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.867733] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.867733] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.867798] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.867882] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.867977] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a55332f-b291-4614-8b34-ee4cd0d39027',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.869044] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.869198] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.869198] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.870122] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.870219] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.870313] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 is going to be updated. [ 829.902994] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.903373] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.903373] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.903479] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.903587] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.917363] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 in Status: IN_PROGRESS for 2s [ 829.961195] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-588 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.961396] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-588" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.961654] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-588" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.961841] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-588" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.962507] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.962507] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.962507] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.962775] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.962874] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.963011] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 829.963132] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 829.963270] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 829.963356] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 829.963468] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 829.963576] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 829.963717] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 829.983578] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 829.983578] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 829.983578] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 829.986746] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-588" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.987416] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-c1537826-3331-49d6-9da7-86232241ef47 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.987416] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-c1537826-3331-49d6-9da7-86232241ef47" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.987586] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-c1537826-3331-49d6-9da7-86232241ef47" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.987761] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-c1537826-3331-49d6-9da7-86232241ef47" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.988278] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1537826-3331-49d6-9da7-86232241ef47',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.264729] env[70614]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] NSXv3 Agent Agent loop - iteration:0 completed [ 830.264729] env[70614]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] NSXv3 Agent Agent loop - iteration:1 started [ 830.321629] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b7b9850-41ce-4284-a095-b60375661eb1 in Status: SUCCESS [ 830.321933] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b7b9850-41ce-4284-a095-b60375661eb1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.376766] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a55332f-b291-4614-8b34-ee4cd0d39027',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.491849] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.494636] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.494636] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.494636] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.494636] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.494807] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port c1537826-3331-49d6-9da7-86232241ef47 not found, creating... [ 830.494985] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.495213] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.495368] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.495616] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.495788] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.497083] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.497083] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.497573] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.497573] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.498202] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.498288] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: c1537826-3331-49d6-9da7-86232241ef47 is going to be created. [ 830.502310] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-328 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.502935] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-328" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.502935] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-328" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.502935] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-328" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.503237] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.503443] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.503610] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.503887] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.504495] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.504802] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 830.505442] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 830.505614] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 830.505760] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 830.507825] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 830.507825] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 830.507825] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 830.534617] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 830.537133] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 830.537133] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 830.537133] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-328" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.537133] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-4abe47ce-cbc2-475e-bb80-594e46a9d7be taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.537133] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-4abe47ce-cbc2-475e-bb80-594e46a9d7be" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.537133] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-4abe47ce-cbc2-475e-bb80-594e46a9d7be" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.537133] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-4abe47ce-cbc2-475e-bb80-594e46a9d7be" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.537133] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4abe47ce-cbc2-475e-bb80-594e46a9d7be',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.539325] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.539968] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.540418] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.541023] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.541433] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.541961] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-c1537826-3331-49d6-9da7-86232241ef47" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.593265] env[70614]: INFO networking_nsxv3.common.synchronization [None req-d5de137b-6ea7-4f57-b372-5bf01d6e2df5 None None] Enqueued Resource ID: f3ba986d-2b93-4e38-9167-9bebcc845eda with Priority: HIGHEST for action port [ 830.593914] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3ba986d-2b93-4e38-9167-9bebcc845eda with Priority: HIGHEST for action port [ 830.594729] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-f3ba986d-2b93-4e38-9167-9bebcc845eda taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.594947] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f3ba986d-2b93-4e38-9167-9bebcc845eda" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.595031] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f3ba986d-2b93-4e38-9167-9bebcc845eda" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.595574] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f3ba986d-2b93-4e38-9167-9bebcc845eda" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.595574] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3ba986d-2b93-4e38-9167-9bebcc845eda',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.883351] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a55332f-b291-4614-8b34-ee4cd0d39027',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.046675] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.046675] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.046813] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.047270] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.047497] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.047765] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 4abe47ce-cbc2-475e-bb80-594e46a9d7be not found, creating... [ 831.048142] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.048404] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.048547] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.049411] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.049607] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.050009] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.050171] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.050314] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.050562] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.050701] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.050884] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 4abe47ce-cbc2-475e-bb80-594e46a9d7be is going to be created. [ 831.077965] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.078423] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.078656] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.079630] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.079630] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.079741] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-4abe47ce-cbc2-475e-bb80-594e46a9d7be" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.107435] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f3ba986d-2b93-4e38-9167-9bebcc845eda [ 831.107435] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.107435] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.107674] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.107787] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.107968] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.108137] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f3ba986d-2b93-4e38-9167-9bebcc845eda already deleted. [ 831.108262] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f3ba986d-2b93-4e38-9167-9bebcc845eda" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.386849] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.387226] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.387226] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.387326] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.387428] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.387528] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a55332f-b291-4614-8b34-ee4cd0d39027 is going to be updated. [ 831.426119] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.426119] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.426119] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.427080] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.428504] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.441518] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a55332f-b291-4614-8b34-ee4cd0d39027 in Status: IN_PROGRESS for 2s [ 831.916196] env[70614]: INFO networking_nsxv3.common.synchronization [req-560a321b-013a-4a05-9876-dbfae53f0f33 req-9ff4d554-659b-48a9-8013-9f76d7b800ba service nova] Enqueued Resource ID: 0a55332f-b291-4614-8b34-ee4cd0d39027 with Priority: HIGHEST for action security_group_rules [ 831.916320] env[70614]: INFO networking_nsxv3.common.synchronization [req-560a321b-013a-4a05-9876-dbfae53f0f33 req-9ff4d554-659b-48a9-8013-9f76d7b800ba service nova] Enqueued Resource ID: 0a55332f-b291-4614-8b34-ee4cd0d39027 with Priority: HIGHEST for action security_group_members [ 831.916440] env[70614]: INFO networking_nsxv3.common.synchronization [req-560a321b-013a-4a05-9876-dbfae53f0f33 req-9ff4d554-659b-48a9-8013-9f76d7b800ba service nova] Enqueued Resource ID: 4abe47ce-cbc2-475e-bb80-594e46a9d7be with Priority: HIGHEST for action port [ 831.917500] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a55332f-b291-4614-8b34-ee4cd0d39027 with Priority: HIGHEST for action security_group_rules [ 831.917500] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a55332f-b291-4614-8b34-ee4cd0d39027 with Priority: HIGHEST for action security_group_members [ 831.917500] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4abe47ce-cbc2-475e-bb80-594e46a9d7be with Priority: HIGHEST for action port [ 831.917500] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a55332f-b291-4614-8b34-ee4cd0d39027 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.917791] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.917791] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.917934] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.918155] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a55332f-b291-4614-8b34-ee4cd0d39027',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.922872] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a55332f-b291-4614-8b34-ee4cd0d39027 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.922872] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.924097] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-4abe47ce-cbc2-475e-bb80-594e46a9d7be taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.924348] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4abe47ce-cbc2-475e-bb80-594e46a9d7be" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.924348] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4abe47ce-cbc2-475e-bb80-594e46a9d7be" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.924558] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4abe47ce-cbc2-475e-bb80-594e46a9d7be" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.924558] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4abe47ce-cbc2-475e-bb80-594e46a9d7be',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.938952] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 in Status: SUCCESS [ 831.938952] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.938952] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.938952] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.938952] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.938952] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.938952] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.938952] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.938952] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.938952] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.938952] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1440acfc-c5d6-4a44-b0a8-654c4f16a7d1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.426872] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a55332f-b291-4614-8b34-ee4cd0d39027 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.427350] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.427350] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4abe47ce-cbc2-475e-bb80-594e46a9d7be with status ACTIVE [ 832.427581] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.427749] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.427845] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.428186] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.428796] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.429152] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.429530] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.429608] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.429803] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.429933] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.430167] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.430319] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.430398] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.430573] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.430653] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.430746] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4abe47ce-cbc2-475e-bb80-594e46a9d7be is going to be updated. [ 832.439215] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.439374] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.439441] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.439741] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.439913] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.440023] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.440183] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.440448] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.440833] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.440833] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.441020] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.441173] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.441323] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.441526] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.441681] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.441777] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.441839] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.441982] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.442083] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.442169] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.442375] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1440acfc-c5d6-4a44-b0a8-654c4f16a7d1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.456466] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.456466] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.456466] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.456466] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.456466] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.456466] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4abe47ce-cbc2-475e-bb80-594e46a9d7be" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.461055] env[70614]: INFO networking_nsxv3.common.synchronization [req-7291913f-11ad-4c82-a2f7-29ff2d141b2f req-06c91ece-9cdb-46da-ba48-b493e572965c service nova] Enqueued Resource ID: 8004bc6e-552e-4ff4-87f0-242b54bbfb5d with Priority: HIGHEST for action security_group_rules [ 832.461055] env[70614]: INFO networking_nsxv3.common.synchronization [req-7291913f-11ad-4c82-a2f7-29ff2d141b2f req-06c91ece-9cdb-46da-ba48-b493e572965c service nova] Enqueued Resource ID: 8004bc6e-552e-4ff4-87f0-242b54bbfb5d with Priority: HIGHEST for action security_group_members [ 832.461055] env[70614]: INFO networking_nsxv3.common.synchronization [req-7291913f-11ad-4c82-a2f7-29ff2d141b2f req-06c91ece-9cdb-46da-ba48-b493e572965c service nova] Enqueued Resource ID: c1537826-3331-49d6-9da7-86232241ef47 with Priority: HIGHEST for action port [ 832.461055] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8004bc6e-552e-4ff4-87f0-242b54bbfb5d with Priority: HIGHEST for action security_group_rules [ 832.461055] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8004bc6e-552e-4ff4-87f0-242b54bbfb5d with Priority: HIGHEST for action security_group_members [ 832.461055] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1537826-3331-49d6-9da7-86232241ef47 with Priority: HIGHEST for action port [ 832.461055] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8004bc6e-552e-4ff4-87f0-242b54bbfb5d taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.461055] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8004bc6e-552e-4ff4-87f0-242b54bbfb5d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.461055] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8004bc6e-552e-4ff4-87f0-242b54bbfb5d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.461055] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8004bc6e-552e-4ff4-87f0-242b54bbfb5d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.461838] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8004bc6e-552e-4ff4-87f0-242b54bbfb5d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.462922] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-8004bc6e-552e-4ff4-87f0-242b54bbfb5d taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.463225] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8004bc6e-552e-4ff4-87f0-242b54bbfb5d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.463380] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8004bc6e-552e-4ff4-87f0-242b54bbfb5d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.463667] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8004bc6e-552e-4ff4-87f0-242b54bbfb5d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.463920] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.464160] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.464338] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.464591] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.464771] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.464951] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8004bc6e-552e-4ff4-87f0-242b54bbfb5d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.466301] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-c1537826-3331-49d6-9da7-86232241ef47 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.466672] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c1537826-3331-49d6-9da7-86232241ef47" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.466822] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c1537826-3331-49d6-9da7-86232241ef47" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.467114] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c1537826-3331-49d6-9da7-86232241ef47" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.467284] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1537826-3331-49d6-9da7-86232241ef47',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.534596] env[70614]: INFO networking_nsxv3.common.synchronization [req-6797d7c2-22f7-414a-aaa9-89e05e0e31b8 req-8f8d0b60-4b1b-44c3-9492-d9a1e6e9794f tempest-ServersAdminNegativeTestJSON-1410393069 tempest-ServersAdminNegativeTestJSON-1410393069-project-member] Enqueued Resource ID: e8c65e5a-d52c-481c-a6b2-680dae9a4593 with Priority: HIGHEST for action security_group_members [ 832.535733] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8c65e5a-d52c-481c-a6b2-680dae9a4593 with Priority: HIGHEST for action security_group_members [ 832.535733] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8c65e5a-d52c-481c-a6b2-680dae9a4593 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.536476] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8c65e5a-d52c-481c-a6b2-680dae9a4593" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.536649] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8c65e5a-d52c-481c-a6b2-680dae9a4593" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.536912] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8c65e5a-d52c-481c-a6b2-680dae9a4593" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.537161] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.537723] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.537723] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.537723] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.537723] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.537723] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e8c65e5a-d52c-481c-a6b2-680dae9a4593',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.944647] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1: rpc.has_security_group_logging(os_id): False [ 832.970358] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-8004bc6e-552e-4ff4-87f0-242b54bbfb5d taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.970604] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8004bc6e-552e-4ff4-87f0-242b54bbfb5d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.970897] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8004bc6e-552e-4ff4-87f0-242b54bbfb5d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.975058] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.975170] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.976032] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.976032] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.976032] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.976525] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.976775] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.976926] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.977248] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.977430] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.979510] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.979510] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.979682] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.980103] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.980103] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.980291] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.980449] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.980542] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.980738] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.981703] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.981703] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 is going to be updated. [ 832.982531] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c1537826-3331-49d6-9da7-86232241ef47 with status ACTIVE [ 832.982973] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.982973] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.982973] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.983232] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.983344] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.983597] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.983674] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.983712] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.983850] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.983927] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.984183] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.984239] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.984270] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.984395] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.984487] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.984584] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c1537826-3331-49d6-9da7-86232241ef47 is going to be updated. [ 833.008498] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.008668] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.008708] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.008907] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.009749] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.009749] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c1537826-3331-49d6-9da7-86232241ef47" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.042712] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e8c65e5a-d52c-481c-a6b2-680dae9a4593',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.081131] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.081416] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.081416] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.081580] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.081821] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.104301] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 in Status: IN_PROGRESS for 2s [ 833.171951] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-573 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.171951] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-573" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.171951] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-573" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.172305] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-573" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.172741] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.172741] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.172925] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.174426] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.174426] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.179023] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 833.179023] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 833.179023] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 833.179023] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 833.179023] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 833.179023] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 833.179023] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 833.287702] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 833.287884] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.112 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 833.288072] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 833.288300] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-573" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.288645] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-bf086209-8450-4ea1-a528-923dcd5e78fb taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.288825] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-bf086209-8450-4ea1-a528-923dcd5e78fb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.288949] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-bf086209-8450-4ea1-a528-923dcd5e78fb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.289358] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-bf086209-8450-4ea1-a528-923dcd5e78fb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.293916] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf086209-8450-4ea1-a528-923dcd5e78fb',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.455140] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a55332f-b291-4614-8b34-ee4cd0d39027 in Status: SUCCESS [ 833.455140] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.455140] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.455140] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.455140] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.455140] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.455140] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.455140] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.455140] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.455140] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a55332f-b291-4614-8b34-ee4cd0d39027',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.489053] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8004bc6e-552e-4ff4-87f0-242b54bbfb5d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.548316] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e8c65e5a-d52c-481c-a6b2-680dae9a4593',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.751228] env[70614]: INFO networking_nsxv3.common.synchronization [None req-31e8b2c5-6632-47c8-bbdb-fdd2d8012ed8 None None] Enqueued Resource ID: af4693c9-16ae-43f2-ab62-2d54e4653a50 with Priority: HIGHEST for action port [ 833.751228] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af4693c9-16ae-43f2-ab62-2d54e4653a50 with Priority: HIGHEST for action port [ 833.752727] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-af4693c9-16ae-43f2-ab62-2d54e4653a50 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.752727] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-af4693c9-16ae-43f2-ab62-2d54e4653a50" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.752727] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-af4693c9-16ae-43f2-ab62-2d54e4653a50" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.752727] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-af4693c9-16ae-43f2-ab62-2d54e4653a50" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.752727] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af4693c9-16ae-43f2-ab62-2d54e4653a50',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.797027] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.797027] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.797027] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.797383] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.797519] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.797794] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port bf086209-8450-4ea1-a528-923dcd5e78fb not found, creating... [ 833.798363] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.800092] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.800092] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.800092] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.800092] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.800092] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.800427] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.800427] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.800991] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.800991] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.801119] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: bf086209-8450-4ea1-a528-923dcd5e78fb is going to be created. [ 833.824576] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.824763] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.828030] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.828030] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.828030] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.828030] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-bf086209-8450-4ea1-a528-923dcd5e78fb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.957198] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a55332f-b291-4614-8b34-ee4cd0d39027',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.990822] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.991057] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.991790] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.991790] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.991790] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.991790] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8004bc6e-552e-4ff4-87f0-242b54bbfb5d is going to be created. [ 834.049591] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.053035] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.053035] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.053035] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.053035] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.053035] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.053035] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.053035] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.054618] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.054886] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.055722] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8c65e5a-d52c-481c-a6b2-680dae9a4593 is going to be updated. [ 834.072879] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8004bc6e-552e-4ff4-87f0-242b54bbfb5d in Status: UNINITIALIZED for 2s [ 834.109776] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.109923] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.109971] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.110261] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.110418] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.122270] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8c65e5a-d52c-481c-a6b2-680dae9a4593 in Status: IN_PROGRESS for 2s [ 834.255777] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port af4693c9-16ae-43f2-ab62-2d54e4653a50 [ 834.256271] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.256413] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.256481] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.256698] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.256784] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.256877] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:af4693c9-16ae-43f2-ab62-2d54e4653a50 already deleted. [ 834.256955] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-af4693c9-16ae-43f2-ab62-2d54e4653a50" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.431339] env[70614]: INFO networking_nsxv3.common.synchronization [None req-6a992bc1-3a9b-4ace-8978-077416b9b90c tempest-ServerActionsTestOtherA-302418031 tempest-ServerActionsTestOtherA-302418031-project-member] Enqueued Resource ID: f58ad372-72ca-472a-aab5-8b86e9d2f1e6 with Priority: HIGHEST for action security_group_rules [ 834.431848] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f58ad372-72ca-472a-aab5-8b86e9d2f1e6 with Priority: HIGHEST for action security_group_rules [ 834.432481] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f58ad372-72ca-472a-aab5-8b86e9d2f1e6 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.432686] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f58ad372-72ca-472a-aab5-8b86e9d2f1e6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.432855] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f58ad372-72ca-472a-aab5-8b86e9d2f1e6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.433208] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f58ad372-72ca-472a-aab5-8b86e9d2f1e6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.433423] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f58ad372-72ca-472a-aab5-8b86e9d2f1e6',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.459966] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a55332f-b291-4614-8b34-ee4cd0d39027',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.619562] env[70614]: INFO networking_nsxv3.common.synchronization [None req-5dec1cc5-ef16-4a7b-9ae0-c1b8fbe42977 tempest-ServerActionsTestOtherA-302418031 tempest-ServerActionsTestOtherA-302418031-project-member] Enqueued Resource ID: f58ad372-72ca-472a-aab5-8b86e9d2f1e6 with Priority: HIGHEST for action security_group_rules [ 834.620111] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f58ad372-72ca-472a-aab5-8b86e9d2f1e6 with Priority: HIGHEST for action security_group_rules [ 834.620498] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f58ad372-72ca-472a-aab5-8b86e9d2f1e6 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.620595] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f58ad372-72ca-472a-aab5-8b86e9d2f1e6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.746905] env[70614]: INFO networking_nsxv3.common.synchronization [req-6797d7c2-22f7-414a-aaa9-89e05e0e31b8 req-46fa43bc-569c-4088-b3f9-4d1423a53f9d service nova] Enqueued Resource ID: e8c65e5a-d52c-481c-a6b2-680dae9a4593 with Priority: HIGHEST for action security_group_rules [ 834.747085] env[70614]: INFO networking_nsxv3.common.synchronization [req-6797d7c2-22f7-414a-aaa9-89e05e0e31b8 req-46fa43bc-569c-4088-b3f9-4d1423a53f9d service nova] Enqueued Resource ID: e8c65e5a-d52c-481c-a6b2-680dae9a4593 with Priority: HIGHEST for action security_group_members [ 834.747233] env[70614]: INFO networking_nsxv3.common.synchronization [req-6797d7c2-22f7-414a-aaa9-89e05e0e31b8 req-46fa43bc-569c-4088-b3f9-4d1423a53f9d service nova] Enqueued Resource ID: bf086209-8450-4ea1-a528-923dcd5e78fb with Priority: HIGHEST for action port [ 834.747872] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8c65e5a-d52c-481c-a6b2-680dae9a4593 with Priority: HIGHEST for action security_group_rules [ 834.748084] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8c65e5a-d52c-481c-a6b2-680dae9a4593 with Priority: HIGHEST for action security_group_members [ 834.749670] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf086209-8450-4ea1-a528-923dcd5e78fb with Priority: HIGHEST for action port [ 834.750757] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e8c65e5a-d52c-481c-a6b2-680dae9a4593 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.751407] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e8c65e5a-d52c-481c-a6b2-680dae9a4593" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.751407] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e8c65e5a-d52c-481c-a6b2-680dae9a4593" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.751407] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e8c65e5a-d52c-481c-a6b2-680dae9a4593" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.751407] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e8c65e5a-d52c-481c-a6b2-680dae9a4593',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.753029] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8c65e5a-d52c-481c-a6b2-680dae9a4593 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.753029] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8c65e5a-d52c-481c-a6b2-680dae9a4593" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.753029] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf086209-8450-4ea1-a528-923dcd5e78fb taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.753029] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf086209-8450-4ea1-a528-923dcd5e78fb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.753029] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf086209-8450-4ea1-a528-923dcd5e78fb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.753029] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf086209-8450-4ea1-a528-923dcd5e78fb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.753029] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf086209-8450-4ea1-a528-923dcd5e78fb',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.963126] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.963126] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.963126] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.963126] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.963126] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.963364] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f58ad372-72ca-472a-aab5-8b86e9d2f1e6 already deleted. [ 834.963364] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f58ad372-72ca-472a-aab5-8b86e9d2f1e6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.963621] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.963724] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.963784] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.963946] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.967026] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.967026] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a55332f-b291-4614-8b34-ee4cd0d39027 is going to be updated. [ 834.967026] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f58ad372-72ca-472a-aab5-8b86e9d2f1e6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.967026] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f58ad372-72ca-472a-aab5-8b86e9d2f1e6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.967026] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f58ad372-72ca-472a-aab5-8b86e9d2f1e6',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.000636] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.000636] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.000636] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.000636] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.000636] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.016635] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a55332f-b291-4614-8b34-ee4cd0d39027 in Status: IN_PROGRESS for 2s [ 835.122998] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 in Status: SUCCESS [ 835.123270] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.257715] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8c65e5a-d52c-481c-a6b2-680dae9a4593 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.258135] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8c65e5a-d52c-481c-a6b2-680dae9a4593" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.262427] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bf086209-8450-4ea1-a528-923dcd5e78fb with status ACTIVE [ 835.262673] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.262814] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.262906] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.263176] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.263281] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.263486] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.263596] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.263656] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.263798] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.263860] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.264058] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.264149] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.264208] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.264389] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.264483] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.264570] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bf086209-8450-4ea1-a528-923dcd5e78fb is going to be updated. [ 835.302841] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.303167] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.303167] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.303942] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.303942] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.303942] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf086209-8450-4ea1-a528-923dcd5e78fb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.494969] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.495388] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.495388] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.495967] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.495967] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.495967] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f58ad372-72ca-472a-aab5-8b86e9d2f1e6 already deleted. [ 835.495967] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f58ad372-72ca-472a-aab5-8b86e9d2f1e6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.083957] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8004bc6e-552e-4ff4-87f0-242b54bbfb5d in Status: SUCCESS [ 836.084221] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8004bc6e-552e-4ff4-87f0-242b54bbfb5d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.084396] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8004bc6e-552e-4ff4-87f0-242b54bbfb5d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.084620] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8004bc6e-552e-4ff4-87f0-242b54bbfb5d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.084815] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.084934] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.084998] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.085174] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.085255] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.085340] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8004bc6e-552e-4ff4-87f0-242b54bbfb5d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.085432] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8004bc6e-552e-4ff4-87f0-242b54bbfb5d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.131860] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8c65e5a-d52c-481c-a6b2-680dae9a4593 in Status: IN_PROGRESS for 4s [ 836.589242] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-8004bc6e-552e-4ff4-87f0-242b54bbfb5d taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.589755] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8004bc6e-552e-4ff4-87f0-242b54bbfb5d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.589755] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8004bc6e-552e-4ff4-87f0-242b54bbfb5d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.589755] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8004bc6e-552e-4ff4-87f0-242b54bbfb5d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.589880] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.589941] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.590023] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.590182] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.590315] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.590375] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8004bc6e-552e-4ff4-87f0-242b54bbfb5d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.590499] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-8004bc6e-552e-4ff4-87f0-242b54bbfb5d taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.590589] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8004bc6e-552e-4ff4-87f0-242b54bbfb5d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.590677] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8004bc6e-552e-4ff4-87f0-242b54bbfb5d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.590781] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8004bc6e-552e-4ff4-87f0-242b54bbfb5d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.590914] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.591011] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.591076] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.591214] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.591286] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.591360] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8004bc6e-552e-4ff4-87f0-242b54bbfb5d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.591449] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8004bc6e-552e-4ff4-87f0-242b54bbfb5d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.027265] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a55332f-b291-4614-8b34-ee4cd0d39027 in Status: SUCCESS [ 837.027509] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.027739] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.028047] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.028344] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.028472] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.028540] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.028707] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.028792] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.028925] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.029049] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0a55332f-b291-4614-8b34-ee4cd0d39027',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.094253] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8004bc6e-552e-4ff4-87f0-242b54bbfb5d: rpc.has_security_group_logging(os_id): False [ 837.113519] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.113707] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.113753] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.113945] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.114050] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.114269] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.114358] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.114507] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.114679] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.114759] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.114943] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.115059] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.115122] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.115263] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.115336] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.115544] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.115641] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.115717] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.116151] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.116151] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.116266] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8004bc6e-552e-4ff4-87f0-242b54bbfb5d is going to be created. [ 837.180086] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.180283] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.180356] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.180513] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.181077] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.196546] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8004bc6e-552e-4ff4-87f0-242b54bbfb5d in Status: IN_PROGRESS for 2s [ 837.342048] env[70614]: INFO networking_nsxv3.common.synchronization [req-ada932a1-27eb-46c0-9aa4-f1410adaa377 req-0b548bed-ecfb-4d65-92d1-fc31c77047f7 tempest-ServerTagsTestJSON-1172360736 tempest-ServerTagsTestJSON-1172360736-project-member] Enqueued Resource ID: 31d51b9f-24c2-407d-92f6-bfa0a20cfef8 with Priority: HIGHEST for action security_group_members [ 837.342048] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31d51b9f-24c2-407d-92f6-bfa0a20cfef8 with Priority: HIGHEST for action security_group_members [ 837.342048] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-31d51b9f-24c2-407d-92f6-bfa0a20cfef8 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.342048] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31d51b9f-24c2-407d-92f6-bfa0a20cfef8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.342048] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31d51b9f-24c2-407d-92f6-bfa0a20cfef8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.342048] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31d51b9f-24c2-407d-92f6-bfa0a20cfef8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.342048] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.342048] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.342048] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.342048] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.342048] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.342048] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('31d51b9f-24c2-407d-92f6-bfa0a20cfef8',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.535234] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a55332f-b291-4614-8b34-ee4cd0d39027 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.535234] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.535234] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.535234] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.535234] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.535234] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.535234] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.535234] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.535234] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.535234] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.535234] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a55332f-b291-4614-8b34-ee4cd0d39027 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.535234] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.535234] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.535234] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.535234] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.535234] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.535859] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.535859] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.535859] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.535859] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.535859] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0a55332f-b291-4614-8b34-ee4cd0d39027',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.845313] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.845604] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.845604] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.845742] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.845838] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.846071] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.846176] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.846240] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.846403] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.846461] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.846548] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31d51b9f-24c2-407d-92f6-bfa0a20cfef8 already deleted. [ 837.846628] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31d51b9f-24c2-407d-92f6-bfa0a20cfef8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.877691] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-107 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.877691] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-107" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.877691] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-107" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.877691] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-107" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.877691] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.878000] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.878000] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.878668] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.878668] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.878668] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 837.878668] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 837.878668] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 837.878883] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 837.878883] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 837.879238] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 837.879238] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 837.900445] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 837.900445] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 837.900598] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 837.900688] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-107" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.901035] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-00d6e4ee-6889-4e1e-aa21-2cd11ec91c71 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.901286] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-00d6e4ee-6889-4e1e-aa21-2cd11ec91c71" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.901503] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-00d6e4ee-6889-4e1e-aa21-2cd11ec91c71" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.901870] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-00d6e4ee-6889-4e1e-aa21-2cd11ec91c71" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.904284] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('00d6e4ee-6889-4e1e-aa21-2cd11ec91c71',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.039026] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0a55332f-b291-4614-8b34-ee4cd0d39027: rpc.has_security_group_logging(os_id): False [ 838.066247] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.066420] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.066465] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.066739] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.066739] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.066947] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.067116] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.067116] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.067288] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.067344] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.067516] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.067605] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.067657] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.067798] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.067871] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.068104] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.068393] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.068393] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.068393] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.068665] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.068665] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a55332f-b291-4614-8b34-ee4cd0d39027 is going to be updated. [ 838.145993] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8c65e5a-d52c-481c-a6b2-680dae9a4593 in Status: SUCCESS [ 838.145993] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8c65e5a-d52c-481c-a6b2-680dae9a4593" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.146281] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8c65e5a-d52c-481c-a6b2-680dae9a4593" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.146823] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8c65e5a-d52c-481c-a6b2-680dae9a4593" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.146823] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.146823] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.146823] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.147126] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.147199] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.147441] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e8c65e5a-d52c-481c-a6b2-680dae9a4593',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.166387] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.166580] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.166633] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.167671] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.167671] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.183192] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a55332f-b291-4614-8b34-ee4cd0d39027 in Status: IN_PROGRESS for 2s [ 838.410949] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.411478] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.411823] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.414185] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.414185] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.414185] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 00d6e4ee-6889-4e1e-aa21-2cd11ec91c71 not found, creating... [ 838.414185] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.414185] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.414185] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.414185] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.414185] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.414185] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.414610] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.414610] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.414610] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.414735] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.414873] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 00d6e4ee-6889-4e1e-aa21-2cd11ec91c71 is going to be created. [ 838.443794] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.444075] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.444266] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.444549] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.444821] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.445109] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-00d6e4ee-6889-4e1e-aa21-2cd11ec91c71" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.650428] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e8c65e5a-d52c-481c-a6b2-680dae9a4593',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.153420] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e8c65e5a-d52c-481c-a6b2-680dae9a4593',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.208902] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8004bc6e-552e-4ff4-87f0-242b54bbfb5d in Status: SUCCESS [ 839.209231] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8004bc6e-552e-4ff4-87f0-242b54bbfb5d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.260808] env[70614]: INFO networking_nsxv3.common.synchronization [req-65a11208-b178-4d7b-be08-37a2a683a518 req-1fc52b54-eb1c-4f99-880b-7483f079521b tempest-SecurityGroupsTestJSON-818479832 tempest-SecurityGroupsTestJSON-818479832-project-member] Enqueued Resource ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 with Priority: HIGHEST for action security_group_members [ 839.261034] env[70614]: INFO networking_nsxv3.common.synchronization [req-65a11208-b178-4d7b-be08-37a2a683a518 req-1fc52b54-eb1c-4f99-880b-7483f079521b tempest-SecurityGroupsTestJSON-818479832 tempest-SecurityGroupsTestJSON-818479832-project-member] Enqueued Resource ID: c3a4718f-fd33-4499-98fb-1aa42d62f34c with Priority: HIGHEST for action security_group_members [ 839.261577] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 with Priority: HIGHEST for action security_group_members [ 839.261712] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3a4718f-fd33-4499-98fb-1aa42d62f34c with Priority: HIGHEST for action security_group_members [ 839.261978] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.262312] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.262439] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.262646] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.262807] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.262907] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.262969] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.263133] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.263216] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.263307] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1440acfc-c5d6-4a44-b0a8-654c4f16a7d1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.264123] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3a4718f-fd33-4499-98fb-1aa42d62f34c taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.264237] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3a4718f-fd33-4499-98fb-1aa42d62f34c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.264307] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3a4718f-fd33-4499-98fb-1aa42d62f34c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.264503] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3a4718f-fd33-4499-98fb-1aa42d62f34c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.264641] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.264736] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.264797] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.264929] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.265036] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.265125] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c3a4718f-fd33-4499-98fb-1aa42d62f34c',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.391830] env[70614]: INFO networking_nsxv3.common.synchronization [req-65a11208-b178-4d7b-be08-37a2a683a518 req-1fc52b54-eb1c-4f99-880b-7483f079521b tempest-SecurityGroupsTestJSON-818479832 tempest-SecurityGroupsTestJSON-818479832-project-member] Enqueued Resource ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 with Priority: HIGHEST for action security_group_rules [ 839.391830] env[70614]: INFO networking_nsxv3.common.synchronization [req-65a11208-b178-4d7b-be08-37a2a683a518 req-1fc52b54-eb1c-4f99-880b-7483f079521b tempest-SecurityGroupsTestJSON-818479832 tempest-SecurityGroupsTestJSON-818479832-project-member] Enqueued Resource ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 with Priority: HIGHEST for action security_group_members [ 839.392025] env[70614]: INFO networking_nsxv3.common.synchronization [req-65a11208-b178-4d7b-be08-37a2a683a518 req-1fc52b54-eb1c-4f99-880b-7483f079521b tempest-SecurityGroupsTestJSON-818479832 tempest-SecurityGroupsTestJSON-818479832-project-member] Enqueued Resource ID: c3a4718f-fd33-4499-98fb-1aa42d62f34c with Priority: HIGHEST for action security_group_rules [ 839.392861] env[70614]: INFO networking_nsxv3.common.synchronization [req-65a11208-b178-4d7b-be08-37a2a683a518 req-1fc52b54-eb1c-4f99-880b-7483f079521b tempest-SecurityGroupsTestJSON-818479832 tempest-SecurityGroupsTestJSON-818479832-project-member] Enqueued Resource ID: c3a4718f-fd33-4499-98fb-1aa42d62f34c with Priority: HIGHEST for action security_group_members [ 839.392861] env[70614]: INFO networking_nsxv3.common.synchronization [req-65a11208-b178-4d7b-be08-37a2a683a518 req-1fc52b54-eb1c-4f99-880b-7483f079521b tempest-SecurityGroupsTestJSON-818479832 tempest-SecurityGroupsTestJSON-818479832-project-member] Enqueued Resource ID: a9be95c1-c975-4177-bf16-9cfdfa853375 with Priority: HIGHEST for action port [ 839.393913] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 with Priority: HIGHEST for action security_group_rules [ 839.394937] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3a4718f-fd33-4499-98fb-1aa42d62f34c with Priority: HIGHEST for action security_group_rules [ 839.394937] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9be95c1-c975-4177-bf16-9cfdfa853375 with Priority: HIGHEST for action port [ 839.394937] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 with Priority: HIGHEST for action security_group_members [ 839.394937] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3a4718f-fd33-4499-98fb-1aa42d62f34c with Priority: HIGHEST for action security_group_members [ 839.394937] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.394937] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.395544] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.395544] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.395753] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1440acfc-c5d6-4a44-b0a8-654c4f16a7d1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.397074] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c3a4718f-fd33-4499-98fb-1aa42d62f34c taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.397293] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c3a4718f-fd33-4499-98fb-1aa42d62f34c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.397382] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c3a4718f-fd33-4499-98fb-1aa42d62f34c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.397687] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c3a4718f-fd33-4499-98fb-1aa42d62f34c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.397804] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c3a4718f-fd33-4499-98fb-1aa42d62f34c',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.398884] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-a9be95c1-c975-4177-bf16-9cfdfa853375 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.398884] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a9be95c1-c975-4177-bf16-9cfdfa853375" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.399283] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a9be95c1-c975-4177-bf16-9cfdfa853375" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.399530] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a9be95c1-c975-4177-bf16-9cfdfa853375" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.399889] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a9be95c1-c975-4177-bf16-9cfdfa853375',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.400815] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.401061] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.401126] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3a4718f-fd33-4499-98fb-1aa42d62f34c taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.401208] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3a4718f-fd33-4499-98fb-1aa42d62f34c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.513473] env[70614]: INFO networking_nsxv3.common.synchronization [req-ada932a1-27eb-46c0-9aa4-f1410adaa377 req-7f38a5a5-c163-4b20-b8e2-4c076cab917b service nova] Enqueued Resource ID: 31d51b9f-24c2-407d-92f6-bfa0a20cfef8 with Priority: HIGHEST for action security_group_rules [ 839.513473] env[70614]: INFO networking_nsxv3.common.synchronization [req-ada932a1-27eb-46c0-9aa4-f1410adaa377 req-7f38a5a5-c163-4b20-b8e2-4c076cab917b service nova] Enqueued Resource ID: 31d51b9f-24c2-407d-92f6-bfa0a20cfef8 with Priority: HIGHEST for action security_group_members [ 839.515923] env[70614]: INFO networking_nsxv3.common.synchronization [req-ada932a1-27eb-46c0-9aa4-f1410adaa377 req-7f38a5a5-c163-4b20-b8e2-4c076cab917b service nova] Enqueued Resource ID: 00d6e4ee-6889-4e1e-aa21-2cd11ec91c71 with Priority: HIGHEST for action port [ 839.515923] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31d51b9f-24c2-407d-92f6-bfa0a20cfef8 with Priority: HIGHEST for action security_group_rules [ 839.515923] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31d51b9f-24c2-407d-92f6-bfa0a20cfef8 with Priority: HIGHEST for action security_group_members [ 839.515923] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00d6e4ee-6889-4e1e-aa21-2cd11ec91c71 with Priority: HIGHEST for action port [ 839.515923] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-31d51b9f-24c2-407d-92f6-bfa0a20cfef8 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.515923] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-31d51b9f-24c2-407d-92f6-bfa0a20cfef8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.515923] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-31d51b9f-24c2-407d-92f6-bfa0a20cfef8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.517695] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-31d51b9f-24c2-407d-92f6-bfa0a20cfef8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.517695] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('31d51b9f-24c2-407d-92f6-bfa0a20cfef8',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.518412] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-31d51b9f-24c2-407d-92f6-bfa0a20cfef8 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.518559] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31d51b9f-24c2-407d-92f6-bfa0a20cfef8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.518677] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31d51b9f-24c2-407d-92f6-bfa0a20cfef8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.518858] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31d51b9f-24c2-407d-92f6-bfa0a20cfef8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.519253] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.519321] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.519421] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.519562] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.519706] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.519754] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('31d51b9f-24c2-407d-92f6-bfa0a20cfef8',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.522378] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-00d6e4ee-6889-4e1e-aa21-2cd11ec91c71 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.522543] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-00d6e4ee-6889-4e1e-aa21-2cd11ec91c71" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.522649] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-00d6e4ee-6889-4e1e-aa21-2cd11ec91c71" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.522896] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-00d6e4ee-6889-4e1e-aa21-2cd11ec91c71" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.522988] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('00d6e4ee-6889-4e1e-aa21-2cd11ec91c71',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.655370] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.655582] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.655677] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.655987] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.656137] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.656262] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8c65e5a-d52c-481c-a6b2-680dae9a4593 is going to be updated. [ 839.692460] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.692460] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.692460] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.692460] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.692460] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.703968] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8c65e5a-d52c-481c-a6b2-680dae9a4593 in Status: IN_PROGRESS for 2s [ 839.770070] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c3a4718f-fd33-4499-98fb-1aa42d62f34c',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.770070] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1440acfc-c5d6-4a44-b0a8-654c4f16a7d1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.902348] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.902581] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.904271] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3a4718f-fd33-4499-98fb-1aa42d62f34c taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.904271] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3a4718f-fd33-4499-98fb-1aa42d62f34c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.904271] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a9be95c1-c975-4177-bf16-9cfdfa853375 with status ACTIVE [ 839.904271] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.904271] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.904271] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.904271] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.904960] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.905832] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.905963] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.906070] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.910026] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.910026] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.910026] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.910026] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.910026] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.910026] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.910026] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.910026] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a9be95c1-c975-4177-bf16-9cfdfa853375 is going to be updated. [ 839.938301] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.938479] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.939026] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.939026] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.939026] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.939186] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a9be95c1-c975-4177-bf16-9cfdfa853375" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.020249] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-31d51b9f-24c2-407d-92f6-bfa0a20cfef8 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.020249] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31d51b9f-24c2-407d-92f6-bfa0a20cfef8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.023693] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('31d51b9f-24c2-407d-92f6-bfa0a20cfef8',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.025364] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 00d6e4ee-6889-4e1e-aa21-2cd11ec91c71 with status ACTIVE [ 840.025584] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.025915] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.025915] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.026089] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.026159] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.026365] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.026467] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.026524] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.028367] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.028481] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.028758] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.029061] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.029061] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.029235] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.029327] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.029572] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 00d6e4ee-6889-4e1e-aa21-2cd11ec91c71 is going to be updated. [ 840.060571] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.060666] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.060744] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.060981] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.061345] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.062610] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-00d6e4ee-6889-4e1e-aa21-2cd11ec91c71" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.205220] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a55332f-b291-4614-8b34-ee4cd0d39027 in Status: SUCCESS [ 840.205505] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.273115] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1440acfc-c5d6-4a44-b0a8-654c4f16a7d1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.274377] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c3a4718f-fd33-4499-98fb-1aa42d62f34c',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.531413] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('31d51b9f-24c2-407d-92f6-bfa0a20cfef8',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.713221] env[70614]: INFO networking_nsxv3.common.synchronization [req-ec820abb-1f07-4586-8a0e-3353ccd332a0 req-3f8c4809-9cc6-453b-a274-893d586e6cb0 tempest-MigrationsAdminTest-2080415140 tempest-MigrationsAdminTest-2080415140-project-member] Enqueued Resource ID: 49dd754e-129e-49c8-9e52-09796cb64337 with Priority: HIGHEST for action security_group_members [ 840.713586] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49dd754e-129e-49c8-9e52-09796cb64337 with Priority: HIGHEST for action security_group_members [ 840.713831] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-49dd754e-129e-49c8-9e52-09796cb64337 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.713958] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.714148] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.714483] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.714675] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.714887] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.714958] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.715649] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.715649] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.715770] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49dd754e-129e-49c8-9e52-09796cb64337',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.776465] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.776653] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.776755] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.777318] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.777318] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.777318] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 is going to be updated. [ 840.778847] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.778921] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.778972] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.779448] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.779538] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.779905] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3a4718f-fd33-4499-98fb-1aa42d62f34c is going to be created. [ 840.814612] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.814612] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.814612] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.814856] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.814856] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.817612] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.817745] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.817890] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.818072] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.818229] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.827545] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3a4718f-fd33-4499-98fb-1aa42d62f34c in Status: UNINITIALIZED for 2s [ 840.827545] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 in Status: IN_PROGRESS for 2s [ 841.035835] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.035835] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.035835] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.036047] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.036120] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.036223] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31d51b9f-24c2-407d-92f6-bfa0a20cfef8 is going to be created. [ 841.064903] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.065199] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.065199] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.065352] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.065515] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.080247] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31d51b9f-24c2-407d-92f6-bfa0a20cfef8 in Status: UNINITIALIZED for 2s [ 841.218651] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('49dd754e-129e-49c8-9e52-09796cb64337',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.314565] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-573 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.314723] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-573" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.314880] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-573" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.319441] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-573" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.319758] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.319939] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.320334] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.320334] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.320488] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.320670] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 841.320914] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 841.320914] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 841.321014] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 841.321098] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 841.321206] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 841.321346] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 841.341636] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 841.341816] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 841.341951] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 841.342153] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-573" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.342564] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-34a8afcd-8bd1-4ad4-a4a6-7ae99fbd9dbc taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.342753] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-34a8afcd-8bd1-4ad4-a4a6-7ae99fbd9dbc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.342876] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-34a8afcd-8bd1-4ad4-a4a6-7ae99fbd9dbc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.343255] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-34a8afcd-8bd1-4ad4-a4a6-7ae99fbd9dbc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.343483] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('34a8afcd-8bd1-4ad4-a4a6-7ae99fbd9dbc',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.714599] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8c65e5a-d52c-481c-a6b2-680dae9a4593 in Status: SUCCESS [ 841.714862] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8c65e5a-d52c-481c-a6b2-680dae9a4593" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.715051] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8c65e5a-d52c-481c-a6b2-680dae9a4593" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.715268] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8c65e5a-d52c-481c-a6b2-680dae9a4593" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.715456] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.715571] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.715636] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.715786] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.715869] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.716023] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8c65e5a-d52c-481c-a6b2-680dae9a4593" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.716091] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e8c65e5a-d52c-481c-a6b2-680dae9a4593',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.721086] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('49dd754e-129e-49c8-9e52-09796cb64337',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.849318] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.850037] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.850037] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.850037] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.850453] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.850453] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 34a8afcd-8bd1-4ad4-a4a6-7ae99fbd9dbc not found, creating... [ 841.850519] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.850667] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.850786] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.850999] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.851271] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.851445] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.851601] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.851717] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.851919] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.852332] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.852541] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 34a8afcd-8bd1-4ad4-a4a6-7ae99fbd9dbc is going to be created. [ 841.876392] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.877809] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.878025] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.879644] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.879899] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.880194] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-34a8afcd-8bd1-4ad4-a4a6-7ae99fbd9dbc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.218530] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8c65e5a-d52c-481c-a6b2-680dae9a4593 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.218668] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8c65e5a-d52c-481c-a6b2-680dae9a4593" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.218668] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8c65e5a-d52c-481c-a6b2-680dae9a4593" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.219164] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8c65e5a-d52c-481c-a6b2-680dae9a4593" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.219381] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.219499] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.219564] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.220178] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.220178] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.220178] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8c65e5a-d52c-481c-a6b2-680dae9a4593" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.220178] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8c65e5a-d52c-481c-a6b2-680dae9a4593 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.220178] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8c65e5a-d52c-481c-a6b2-680dae9a4593" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.220536] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8c65e5a-d52c-481c-a6b2-680dae9a4593" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.220536] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8c65e5a-d52c-481c-a6b2-680dae9a4593" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.220536] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.220536] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.220730] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.220730] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.220846] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.220892] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8c65e5a-d52c-481c-a6b2-680dae9a4593" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.220968] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e8c65e5a-d52c-481c-a6b2-680dae9a4593',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.222436] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.222563] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.222619] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.222756] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.222839] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.222929] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49dd754e-129e-49c8-9e52-09796cb64337 is going to be updated. [ 842.254450] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.254684] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.254684] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.254870] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.255030] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.267782] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49dd754e-129e-49c8-9e52-09796cb64337 in Status: IN_PROGRESS for 2s [ 842.726103] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e8c65e5a-d52c-481c-a6b2-680dae9a4593: rpc.has_security_group_logging(os_id): False [ 842.748038] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.748038] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.748038] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.748038] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.748038] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.748608] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.748909] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.749471] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.749851] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.750036] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.750476] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.750681] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.750823] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.751060] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.752026] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.752026] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.752026] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.752026] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.752026] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.752026] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.752026] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e8c65e5a-d52c-481c-a6b2-680dae9a4593 is going to be updated. [ 842.812981] env[70614]: INFO networking_nsxv3.common.synchronization [req-ec820abb-1f07-4586-8a0e-3353ccd332a0 req-e69dcf51-a855-4e9a-9ef0-3f3b053eb60a service nova] Enqueued Resource ID: 49dd754e-129e-49c8-9e52-09796cb64337 with Priority: HIGHEST for action security_group_rules [ 842.812981] env[70614]: INFO networking_nsxv3.common.synchronization [req-ec820abb-1f07-4586-8a0e-3353ccd332a0 req-e69dcf51-a855-4e9a-9ef0-3f3b053eb60a service nova] Enqueued Resource ID: 49dd754e-129e-49c8-9e52-09796cb64337 with Priority: HIGHEST for action security_group_members [ 842.812981] env[70614]: INFO networking_nsxv3.common.synchronization [req-ec820abb-1f07-4586-8a0e-3353ccd332a0 req-e69dcf51-a855-4e9a-9ef0-3f3b053eb60a service nova] Enqueued Resource ID: 34a8afcd-8bd1-4ad4-a4a6-7ae99fbd9dbc with Priority: HIGHEST for action port [ 842.812981] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49dd754e-129e-49c8-9e52-09796cb64337 with Priority: HIGHEST for action security_group_rules [ 842.812981] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49dd754e-129e-49c8-9e52-09796cb64337 with Priority: HIGHEST for action security_group_members [ 842.812981] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34a8afcd-8bd1-4ad4-a4a6-7ae99fbd9dbc with Priority: HIGHEST for action port [ 842.815236] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49dd754e-129e-49c8-9e52-09796cb64337 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.815236] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.815236] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.815236] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.815505] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49dd754e-129e-49c8-9e52-09796cb64337',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.817331] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-49dd754e-129e-49c8-9e52-09796cb64337 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.817331] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.817331] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-34a8afcd-8bd1-4ad4-a4a6-7ae99fbd9dbc taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.817331] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-34a8afcd-8bd1-4ad4-a4a6-7ae99fbd9dbc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.817331] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-34a8afcd-8bd1-4ad4-a4a6-7ae99fbd9dbc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.817331] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-34a8afcd-8bd1-4ad4-a4a6-7ae99fbd9dbc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.817331] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('34a8afcd-8bd1-4ad4-a4a6-7ae99fbd9dbc',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.823737] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.823737] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.823737] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.823737] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.823737] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.842455] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 in Status: SUCCESS [ 842.842455] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.842455] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.842455] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.842455] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.842455] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.842455] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.842455] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.842455] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.842455] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1440acfc-c5d6-4a44-b0a8-654c4f16a7d1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.846445] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e8c65e5a-d52c-481c-a6b2-680dae9a4593 in Status: IN_PROGRESS for 2s [ 842.847787] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3a4718f-fd33-4499-98fb-1aa42d62f34c in Status: SUCCESS [ 842.848154] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3a4718f-fd33-4499-98fb-1aa42d62f34c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.848547] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3a4718f-fd33-4499-98fb-1aa42d62f34c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.848821] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3a4718f-fd33-4499-98fb-1aa42d62f34c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.849064] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.852652] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.852710] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.852918] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.853560] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.853560] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c3a4718f-fd33-4499-98fb-1aa42d62f34c',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.092759] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31d51b9f-24c2-407d-92f6-bfa0a20cfef8 in Status: SUCCESS [ 843.093102] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31d51b9f-24c2-407d-92f6-bfa0a20cfef8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.093222] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31d51b9f-24c2-407d-92f6-bfa0a20cfef8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.093408] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31d51b9f-24c2-407d-92f6-bfa0a20cfef8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.093607] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.093762] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.093835] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.094039] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.094039] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.094144] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31d51b9f-24c2-407d-92f6-bfa0a20cfef8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.094180] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('31d51b9f-24c2-407d-92f6-bfa0a20cfef8',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.216238] env[70614]: INFO networking_nsxv3.common.synchronization [None req-04b1146d-c095-479b-b2da-3cf25ee8056a None None] Enqueued Resource ID: a3adfbaf-1c56-483b-ab82-db198149db6c with Priority: HIGHEST for action port [ 843.216648] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3adfbaf-1c56-483b-ab82-db198149db6c with Priority: HIGHEST for action port [ 843.216989] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-a3adfbaf-1c56-483b-ab82-db198149db6c taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.217148] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a3adfbaf-1c56-483b-ab82-db198149db6c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.218146] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a3adfbaf-1c56-483b-ab82-db198149db6c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.218146] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a3adfbaf-1c56-483b-ab82-db198149db6c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.218146] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3adfbaf-1c56-483b-ab82-db198149db6c',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.319224] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-49dd754e-129e-49c8-9e52-09796cb64337 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.319586] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.328213] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 34a8afcd-8bd1-4ad4-a4a6-7ae99fbd9dbc with status ACTIVE [ 843.328459] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.328715] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.328715] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.328932] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.328932] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.329098] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.329207] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.329271] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.329417] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.329499] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.329680] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.329803] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.329853] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.330783] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.330783] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.330783] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 34a8afcd-8bd1-4ad4-a4a6-7ae99fbd9dbc is going to be updated. [ 843.337143] env[70614]: INFO networking_nsxv3.common.synchronization [req-2fed6859-add6-4875-a439-6643322057fa req-e6090bfb-9e3b-4b90-8b65-1b41ed497c56 tempest-FloatingIPsAssociationNegativeTestJSON-663480402 tempest-FloatingIPsAssociationNegativeTestJSON-663480402-project-member] Enqueued Resource ID: 2db7d87e-43a6-451c-9080-385c174466ee with Priority: HIGHEST for action security_group_members [ 843.337742] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2db7d87e-43a6-451c-9080-385c174466ee with Priority: HIGHEST for action security_group_members [ 843.339682] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-2db7d87e-43a6-451c-9080-385c174466ee taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.339839] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2db7d87e-43a6-451c-9080-385c174466ee" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.339899] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2db7d87e-43a6-451c-9080-385c174466ee" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.340061] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2db7d87e-43a6-451c-9080-385c174466ee" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.340313] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.340313] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.340442] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.340498] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.340579] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.340790] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2db7d87e-43a6-451c-9080-385c174466ee',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.344805] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1440acfc-c5d6-4a44-b0a8-654c4f16a7d1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.355272] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c3a4718f-fd33-4499-98fb-1aa42d62f34c',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.361714] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.362408] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.362537] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.362733] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.362893] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.363171] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-34a8afcd-8bd1-4ad4-a4a6-7ae99fbd9dbc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.597992] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-31d51b9f-24c2-407d-92f6-bfa0a20cfef8 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.597992] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31d51b9f-24c2-407d-92f6-bfa0a20cfef8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.598371] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31d51b9f-24c2-407d-92f6-bfa0a20cfef8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.598426] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31d51b9f-24c2-407d-92f6-bfa0a20cfef8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.600134] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.600134] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.600134] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.600134] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.600134] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.600134] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31d51b9f-24c2-407d-92f6-bfa0a20cfef8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.600134] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-31d51b9f-24c2-407d-92f6-bfa0a20cfef8 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.600134] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31d51b9f-24c2-407d-92f6-bfa0a20cfef8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.600134] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31d51b9f-24c2-407d-92f6-bfa0a20cfef8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.600134] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31d51b9f-24c2-407d-92f6-bfa0a20cfef8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.600134] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.600134] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.600134] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.600134] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.603331] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.603331] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31d51b9f-24c2-407d-92f6-bfa0a20cfef8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.603331] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('31d51b9f-24c2-407d-92f6-bfa0a20cfef8',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.720048] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a3adfbaf-1c56-483b-ab82-db198149db6c [ 843.720048] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.720048] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.720364] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.721393] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.721393] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.721393] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a3adfbaf-1c56-483b-ab82-db198149db6c already deleted. [ 843.721393] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a3adfbaf-1c56-483b-ab82-db198149db6c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.843176] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.843396] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.843491] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.843786] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.843881] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.844110] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.845031] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.845031] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.845031] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.845031] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.845031] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2db7d87e-43a6-451c-9080-385c174466ee is going to be updated. [ 843.846444] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1440acfc-c5d6-4a44-b0a8-654c4f16a7d1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.857236] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c3a4718f-fd33-4499-98fb-1aa42d62f34c',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.880027] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.880259] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.880582] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.880973] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.881394] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.896288] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2db7d87e-43a6-451c-9080-385c174466ee in Status: IN_PROGRESS for 2s [ 844.104870] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 31d51b9f-24c2-407d-92f6-bfa0a20cfef8: rpc.has_security_group_logging(os_id): False [ 844.125505] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.125656] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.125728] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.125985] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.126105] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.126289] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.126385] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.126480] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.126600] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.126678] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.126848] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.126942] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.127019] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.127166] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.127243] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.127848] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.127848] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.127848] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.127848] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.127848] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.127848] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 31d51b9f-24c2-407d-92f6-bfa0a20cfef8 is going to be created. [ 844.212410] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.212644] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.212717] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.212944] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.213163] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.225776] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 31d51b9f-24c2-407d-92f6-bfa0a20cfef8 in Status: IN_PROGRESS for 2s [ 844.279462] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49dd754e-129e-49c8-9e52-09796cb64337 in Status: SUCCESS [ 844.279879] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.280149] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.280466] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.280672] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.280796] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.280865] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.281039] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.281126] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.281223] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49dd754e-129e-49c8-9e52-09796cb64337',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.350361] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.350361] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.350361] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.350361] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.350361] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.350361] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 is going to be updated. [ 844.360184] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.360323] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.360368] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.361071] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.361071] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.361071] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3a4718f-fd33-4499-98fb-1aa42d62f34c is going to be updated. [ 844.388666] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.389563] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.389563] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.389563] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.389563] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.391448] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.391676] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.391676] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.391899] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.391899] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.402984] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3a4718f-fd33-4499-98fb-1aa42d62f34c in Status: IN_PROGRESS for 2s [ 844.408953] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 in Status: IN_PROGRESS for 2s [ 844.482193] env[70614]: INFO networking_nsxv3.common.synchronization [req-077e9ab8-e531-4dc6-9c79-474c7ffecf35 req-4a2a4c9c-9a10-41ce-bf17-dff51aa3bfc1 tempest-ServerMetadataNegativeTestJSON-1965133638 tempest-ServerMetadataNegativeTestJSON-1965133638-project-member] Enqueued Resource ID: 6b7b9850-41ce-4284-a095-b60375661eb1 with Priority: HIGHEST for action security_group_members [ 844.482193] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b7b9850-41ce-4284-a095-b60375661eb1 with Priority: HIGHEST for action security_group_members [ 844.482193] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b7b9850-41ce-4284-a095-b60375661eb1 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.482193] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b7b9850-41ce-4284-a095-b60375661eb1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.482594] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b7b9850-41ce-4284-a095-b60375661eb1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.482594] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b7b9850-41ce-4284-a095-b60375661eb1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.482983] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.482983] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.482983] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.483335] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.483510] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.483510] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b7b9850-41ce-4284-a095-b60375661eb1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.784656] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('49dd754e-129e-49c8-9e52-09796cb64337',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.862992] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e8c65e5a-d52c-481c-a6b2-680dae9a4593 in Status: SUCCESS [ 844.863440] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e8c65e5a-d52c-481c-a6b2-680dae9a4593" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.987050] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.987275] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.987336] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.989312] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.989312] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.989312] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.989312] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.989312] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.990577] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.990577] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.990577] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b7b9850-41ce-4284-a095-b60375661eb1 is going to be updated. [ 845.021243] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.021243] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.021243] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.021243] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.021486] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.033474] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b7b9850-41ce-4284-a095-b60375661eb1 in Status: IN_PROGRESS for 2s [ 845.257215] env[70614]: INFO networking_nsxv3.common.synchronization [None req-f8a3f651-e582-4f62-8a05-b3ad0f096625 None None] Enqueued Resource ID: b5ff0280-78a6-4628-ac6f-0bf1529ac74f with Priority: HIGHEST for action port [ 845.257215] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5ff0280-78a6-4628-ac6f-0bf1529ac74f with Priority: HIGHEST for action port [ 845.257385] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-b5ff0280-78a6-4628-ac6f-0bf1529ac74f taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.257562] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b5ff0280-78a6-4628-ac6f-0bf1529ac74f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.257607] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b5ff0280-78a6-4628-ac6f-0bf1529ac74f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.258309] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b5ff0280-78a6-4628-ac6f-0bf1529ac74f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.258309] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5ff0280-78a6-4628-ac6f-0bf1529ac74f',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.287587] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('49dd754e-129e-49c8-9e52-09796cb64337',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.681723] env[70614]: INFO networking_nsxv3.common.synchronization [req-49d0ebab-7355-44ba-a261-35edc39d8597 req-bd7dbb01-2705-4e2e-b6db-349dd24fb239 tempest-SecurityGroupRulesTestJSON-1402624318 tempest-SecurityGroupRulesTestJSON-1402624318-project-member] Enqueued Resource ID: 8e4427aa-35fc-4d13-9525-b02a1ef4664b with Priority: HIGHEST for action security_group_rules [ 845.681723] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e4427aa-35fc-4d13-9525-b02a1ef4664b with Priority: HIGHEST for action security_group_rules [ 845.681723] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8e4427aa-35fc-4d13-9525-b02a1ef4664b taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.681723] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8e4427aa-35fc-4d13-9525-b02a1ef4664b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.682383] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8e4427aa-35fc-4d13-9525-b02a1ef4664b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.682383] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8e4427aa-35fc-4d13-9525-b02a1ef4664b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.682383] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8e4427aa-35fc-4d13-9525-b02a1ef4664b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.760754] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b5ff0280-78a6-4628-ac6f-0bf1529ac74f [ 845.760754] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.760754] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.760754] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.761039] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.761039] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.761039] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b5ff0280-78a6-4628-ac6f-0bf1529ac74f already deleted. [ 845.761182] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b5ff0280-78a6-4628-ac6f-0bf1529ac74f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.792052] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.792052] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.792052] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.792052] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.792052] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.792052] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49dd754e-129e-49c8-9e52-09796cb64337 is going to be updated. [ 845.822634] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.822634] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.822819] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.822909] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.823065] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.835725] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49dd754e-129e-49c8-9e52-09796cb64337 in Status: IN_PROGRESS for 2s [ 845.909755] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2db7d87e-43a6-451c-9080-385c174466ee in Status: SUCCESS [ 845.909755] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2db7d87e-43a6-451c-9080-385c174466ee deletion is rescheduled due to dependency. [ 845.909916] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2db7d87e-43a6-451c-9080-385c174466ee" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.221472] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.221942] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.222131] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.222448] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.223213] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.224149] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8e4427aa-35fc-4d13-9525-b02a1ef4664b already deleted. [ 846.224475] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8e4427aa-35fc-4d13-9525-b02a1ef4664b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.242091] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 31d51b9f-24c2-407d-92f6-bfa0a20cfef8 in Status: SUCCESS [ 846.242336] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-31d51b9f-24c2-407d-92f6-bfa0a20cfef8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.414056] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3a4718f-fd33-4499-98fb-1aa42d62f34c in Status: SUCCESS [ 846.414267] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3a4718f-fd33-4499-98fb-1aa42d62f34c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.414550] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3a4718f-fd33-4499-98fb-1aa42d62f34c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.414842] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3a4718f-fd33-4499-98fb-1aa42d62f34c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.415160] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.415277] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.415526] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.415761] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.415889] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.416036] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3a4718f-fd33-4499-98fb-1aa42d62f34c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.416189] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c3a4718f-fd33-4499-98fb-1aa42d62f34c',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.420025] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 in Status: SUCCESS [ 846.420025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.420025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.420025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.420331] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.420331] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.421451] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.421721] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.421846] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.421978] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.422135] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1440acfc-c5d6-4a44-b0a8-654c4f16a7d1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.540780] env[70614]: INFO networking_nsxv3.common.synchronization [req-d42564ff-3774-4f87-8368-ff86c045b324 req-d05908bf-931c-40d9-8174-a8bf0aa48efd tempest-SecurityGroupRulesTestJSON-1402624318 tempest-SecurityGroupRulesTestJSON-1402624318-project-member] Enqueued Resource ID: 667edbd4-71b0-44b4-ad4c-9aee04beecc4 with Priority: HIGHEST for action security_group_rules [ 846.540780] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 667edbd4-71b0-44b4-ad4c-9aee04beecc4 with Priority: HIGHEST for action security_group_rules [ 846.541040] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-667edbd4-71b0-44b4-ad4c-9aee04beecc4 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.541040] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-667edbd4-71b0-44b4-ad4c-9aee04beecc4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.541040] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-667edbd4-71b0-44b4-ad4c-9aee04beecc4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.541310] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-667edbd4-71b0-44b4-ad4c-9aee04beecc4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.541666] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('667edbd4-71b0-44b4-ad4c-9aee04beecc4',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.918786] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c3a4718f-fd33-4499-98fb-1aa42d62f34c',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.927797] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.928490] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.928490] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.928490] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.928490] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.928776] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.928776] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.928867] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.929028] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.929028] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.929188] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.930188] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.930188] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.930188] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.930188] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.930188] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.930188] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.930188] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.930188] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.930188] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.930188] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1440acfc-c5d6-4a44-b0a8-654c4f16a7d1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.047367] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b7b9850-41ce-4284-a095-b60375661eb1 in Status: SUCCESS [ 847.047673] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b7b9850-41ce-4284-a095-b60375661eb1 deletion is rescheduled due to dependency. [ 847.047769] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b7b9850-41ce-4284-a095-b60375661eb1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.071617] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.071728] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.071728] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.071927] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.076026] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.076026] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 667edbd4-71b0-44b4-ad4c-9aee04beecc4 already deleted. [ 847.076026] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-667edbd4-71b0-44b4-ad4c-9aee04beecc4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.095634] env[70614]: INFO networking_nsxv3.common.synchronization [req-e0f2f9a2-6075-4367-be9f-75aca838e4fb req-00f9fb71-06c5-4a4e-bcdd-90b52d9ec593 tempest-SecurityGroupsTestJSON-818479832 tempest-SecurityGroupsTestJSON-818479832-project-member] Enqueued Resource ID: 42290a32-653b-4fbe-bf3c-54a980c12617 with Priority: HIGHEST for action security_group_members [ 847.095841] env[70614]: INFO networking_nsxv3.common.synchronization [req-e0f2f9a2-6075-4367-be9f-75aca838e4fb req-00f9fb71-06c5-4a4e-bcdd-90b52d9ec593 tempest-SecurityGroupsTestJSON-818479832 tempest-SecurityGroupsTestJSON-818479832-project-member] Enqueued Resource ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 with Priority: HIGHEST for action security_group_members [ 847.100026] env[70614]: INFO networking_nsxv3.common.synchronization [req-e0f2f9a2-6075-4367-be9f-75aca838e4fb req-00f9fb71-06c5-4a4e-bcdd-90b52d9ec593 tempest-SecurityGroupsTestJSON-818479832 tempest-SecurityGroupsTestJSON-818479832-project-member] Enqueued Resource ID: c3a4718f-fd33-4499-98fb-1aa42d62f34c with Priority: HIGHEST for action security_group_members [ 847.100026] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42290a32-653b-4fbe-bf3c-54a980c12617 with Priority: HIGHEST for action security_group_members [ 847.100026] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 with Priority: HIGHEST for action security_group_members [ 847.100026] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3a4718f-fd33-4499-98fb-1aa42d62f34c with Priority: HIGHEST for action security_group_members [ 847.100026] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-42290a32-653b-4fbe-bf3c-54a980c12617 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.100026] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42290a32-653b-4fbe-bf3c-54a980c12617" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.100026] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42290a32-653b-4fbe-bf3c-54a980c12617" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.100026] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42290a32-653b-4fbe-bf3c-54a980c12617" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.100026] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.100026] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.100026] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.100026] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.100026] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.100026] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('42290a32-653b-4fbe-bf3c-54a980c12617',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.100026] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.100026] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.100026] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.100026] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.100872] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.100872] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.100872] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.100872] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.100872] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.100872] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1440acfc-c5d6-4a44-b0a8-654c4f16a7d1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.103624] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3a4718f-fd33-4499-98fb-1aa42d62f34c taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.103624] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3a4718f-fd33-4499-98fb-1aa42d62f34c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.103624] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3a4718f-fd33-4499-98fb-1aa42d62f34c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.103624] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3a4718f-fd33-4499-98fb-1aa42d62f34c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.103624] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.103624] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.103624] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.103624] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.103624] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.103624] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c3a4718f-fd33-4499-98fb-1aa42d62f34c',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.157650] env[70614]: INFO networking_nsxv3.common.synchronization [req-e0f2f9a2-6075-4367-be9f-75aca838e4fb req-00f9fb71-06c5-4a4e-bcdd-90b52d9ec593 tempest-SecurityGroupsTestJSON-818479832 tempest-SecurityGroupsTestJSON-818479832-project-member] Enqueued Resource ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 with Priority: HIGHEST for action security_group_rules [ 847.157650] env[70614]: INFO networking_nsxv3.common.synchronization [req-e0f2f9a2-6075-4367-be9f-75aca838e4fb req-00f9fb71-06c5-4a4e-bcdd-90b52d9ec593 tempest-SecurityGroupsTestJSON-818479832 tempest-SecurityGroupsTestJSON-818479832-project-member] Enqueued Resource ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 with Priority: HIGHEST for action security_group_members [ 847.157650] env[70614]: INFO networking_nsxv3.common.synchronization [req-e0f2f9a2-6075-4367-be9f-75aca838e4fb req-00f9fb71-06c5-4a4e-bcdd-90b52d9ec593 tempest-SecurityGroupsTestJSON-818479832 tempest-SecurityGroupsTestJSON-818479832-project-member] Enqueued Resource ID: 42290a32-653b-4fbe-bf3c-54a980c12617 with Priority: HIGHEST for action security_group_rules [ 847.157650] env[70614]: INFO networking_nsxv3.common.synchronization [req-e0f2f9a2-6075-4367-be9f-75aca838e4fb req-00f9fb71-06c5-4a4e-bcdd-90b52d9ec593 tempest-SecurityGroupsTestJSON-818479832 tempest-SecurityGroupsTestJSON-818479832-project-member] Enqueued Resource ID: 42290a32-653b-4fbe-bf3c-54a980c12617 with Priority: HIGHEST for action security_group_members [ 847.158648] env[70614]: INFO networking_nsxv3.common.synchronization [req-e0f2f9a2-6075-4367-be9f-75aca838e4fb req-00f9fb71-06c5-4a4e-bcdd-90b52d9ec593 tempest-SecurityGroupsTestJSON-818479832 tempest-SecurityGroupsTestJSON-818479832-project-member] Enqueued Resource ID: c3a4718f-fd33-4499-98fb-1aa42d62f34c with Priority: HIGHEST for action security_group_rules [ 847.158648] env[70614]: INFO networking_nsxv3.common.synchronization [req-e0f2f9a2-6075-4367-be9f-75aca838e4fb req-00f9fb71-06c5-4a4e-bcdd-90b52d9ec593 tempest-SecurityGroupsTestJSON-818479832 tempest-SecurityGroupsTestJSON-818479832-project-member] Enqueued Resource ID: c3a4718f-fd33-4499-98fb-1aa42d62f34c with Priority: HIGHEST for action security_group_members [ 847.158648] env[70614]: INFO networking_nsxv3.common.synchronization [req-e0f2f9a2-6075-4367-be9f-75aca838e4fb req-00f9fb71-06c5-4a4e-bcdd-90b52d9ec593 tempest-SecurityGroupsTestJSON-818479832 tempest-SecurityGroupsTestJSON-818479832-project-member] Enqueued Resource ID: a9be95c1-c975-4177-bf16-9cfdfa853375 with Priority: HIGHEST for action port [ 847.158946] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 with Priority: HIGHEST for action security_group_rules [ 847.159080] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42290a32-653b-4fbe-bf3c-54a980c12617 with Priority: HIGHEST for action security_group_rules [ 847.159242] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3a4718f-fd33-4499-98fb-1aa42d62f34c with Priority: HIGHEST for action security_group_members [ 847.159299] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9be95c1-c975-4177-bf16-9cfdfa853375 with Priority: HIGHEST for action port [ 847.159387] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3a4718f-fd33-4499-98fb-1aa42d62f34c with Priority: HIGHEST for action security_group_rules [ 847.159475] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 with Priority: HIGHEST for action security_group_members [ 847.159558] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42290a32-653b-4fbe-bf3c-54a980c12617 with Priority: HIGHEST for action security_group_members [ 847.159842] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.159951] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.160141] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-42290a32-653b-4fbe-bf3c-54a980c12617 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.160249] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-42290a32-653b-4fbe-bf3c-54a980c12617" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.160303] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-42290a32-653b-4fbe-bf3c-54a980c12617" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.160572] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-42290a32-653b-4fbe-bf3c-54a980c12617" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.160654] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('42290a32-653b-4fbe-bf3c-54a980c12617',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.161783] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3a4718f-fd33-4499-98fb-1aa42d62f34c taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.161783] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3a4718f-fd33-4499-98fb-1aa42d62f34c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.161958] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-a9be95c1-c975-4177-bf16-9cfdfa853375 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.161958] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a9be95c1-c975-4177-bf16-9cfdfa853375" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.162110] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a9be95c1-c975-4177-bf16-9cfdfa853375" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.162189] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a9be95c1-c975-4177-bf16-9cfdfa853375" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.162264] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a9be95c1-c975-4177-bf16-9cfdfa853375',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.163030] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c3a4718f-fd33-4499-98fb-1aa42d62f34c taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.163124] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c3a4718f-fd33-4499-98fb-1aa42d62f34c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.167227] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.167227] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.167227] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-42290a32-653b-4fbe-bf3c-54a980c12617 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.167227] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42290a32-653b-4fbe-bf3c-54a980c12617" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.420669] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c3a4718f-fd33-4499-98fb-1aa42d62f34c: rpc.has_security_group_logging(os_id): False [ 847.433710] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1: rpc.has_security_group_logging(os_id): False [ 847.448660] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.448660] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.448660] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.448803] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.448835] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.449111] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.449229] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.452813] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.452813] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.452813] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.452813] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c3a4718f-fd33-4499-98fb-1aa42d62f34c is going to be created. [ 847.453451] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.453575] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.453640] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.453838] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.453923] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.454160] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.454255] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.454316] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.454464] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.454536] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.455086] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.455086] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.455086] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.455086] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.455273] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.455328] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.455422] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.455480] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.456080] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.456152] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.456238] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 is going to be updated. [ 847.604728] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('42290a32-653b-4fbe-bf3c-54a980c12617',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.606086] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1440acfc-c5d6-4a44-b0a8-654c4f16a7d1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.610663] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c3a4718f-fd33-4499-98fb-1aa42d62f34c',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.649073] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.649284] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.649361] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.649575] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.649754] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.662889] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c3a4718f-fd33-4499-98fb-1aa42d62f34c in Status: IN_PROGRESS for 2s [ 847.664418] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-42290a32-653b-4fbe-bf3c-54a980c12617 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.664578] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42290a32-653b-4fbe-bf3c-54a980c12617" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.664699] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a9be95c1-c975-4177-bf16-9cfdfa853375 with status ACTIVE [ 847.664854] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.664959] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.665074] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.667086] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.667086] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.667086] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.667086] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.667086] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.667086] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.667086] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.667086] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.667086] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.667086] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.667086] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.667086] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.667086] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a9be95c1-c975-4177-bf16-9cfdfa853375 is going to be updated. [ 847.673993] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.673993] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.673993] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.673993] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.673993] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.695330] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.695456] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.695510] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.695734] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.695882] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.696067] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a9be95c1-c975-4177-bf16-9cfdfa853375" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.696928] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 in Status: IN_PROGRESS for 2s [ 847.850023] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49dd754e-129e-49c8-9e52-09796cb64337 in Status: SUCCESS [ 847.850023] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.850259] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.850330] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.850528] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.850646] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.850710] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.850894] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.850972] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.851068] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.851160] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('49dd754e-129e-49c8-9e52-09796cb64337',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.890136] env[70614]: INFO networking_nsxv3.common.synchronization [None req-f72c99e4-5850-4549-9504-fdd79427202b None None] Enqueued Resource ID: 5378570c-d9a2-4e57-8003-65e72d536b08 with Priority: HIGHEST for action port [ 847.890136] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5378570c-d9a2-4e57-8003-65e72d536b08 with Priority: HIGHEST for action port [ 847.890475] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-5378570c-d9a2-4e57-8003-65e72d536b08 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.890783] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5378570c-d9a2-4e57-8003-65e72d536b08" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.890938] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5378570c-d9a2-4e57-8003-65e72d536b08" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.891511] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5378570c-d9a2-4e57-8003-65e72d536b08" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.891715] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5378570c-d9a2-4e57-8003-65e72d536b08',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.023880] env[70614]: INFO networking_nsxv3.common.synchronization [req-cd9e11dd-467f-4c62-9b37-050b327c5913 req-fecbd00d-3db3-49cf-821d-e91e51892959 tempest-SecurityGroupRulesTestJSON-1402624318 tempest-SecurityGroupRulesTestJSON-1402624318-project-member] Enqueued Resource ID: a45625f2-6a96-4ec3-86ef-3688d1aa762b with Priority: HIGHEST for action security_group_rules [ 848.023880] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a45625f2-6a96-4ec3-86ef-3688d1aa762b with Priority: HIGHEST for action security_group_rules [ 848.023880] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a45625f2-6a96-4ec3-86ef-3688d1aa762b taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.023880] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a45625f2-6a96-4ec3-86ef-3688d1aa762b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.023880] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a45625f2-6a96-4ec3-86ef-3688d1aa762b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.025403] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a45625f2-6a96-4ec3-86ef-3688d1aa762b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.025940] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a45625f2-6a96-4ec3-86ef-3688d1aa762b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.114948] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('42290a32-653b-4fbe-bf3c-54a980c12617',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.117114] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1440acfc-c5d6-4a44-b0a8-654c4f16a7d1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.117114] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c3a4718f-fd33-4499-98fb-1aa42d62f34c',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.354497] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-49dd754e-129e-49c8-9e52-09796cb64337 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.354641] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.354767] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.354908] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.355080] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.355477] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.355477] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.355477] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.355477] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.355891] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.355891] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-49dd754e-129e-49c8-9e52-09796cb64337 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.355891] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.355891] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.356175] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.356175] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.356175] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.356392] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.356392] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.356508] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.356508] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.356603] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('49dd754e-129e-49c8-9e52-09796cb64337',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.395069] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5378570c-d9a2-4e57-8003-65e72d536b08 [ 848.396927] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.396927] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.396927] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.396927] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.398045] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.398045] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5378570c-d9a2-4e57-8003-65e72d536b08 already deleted. [ 848.398045] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5378570c-d9a2-4e57-8003-65e72d536b08" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.547655] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.548927] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.548927] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.548927] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.548927] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.548927] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a45625f2-6a96-4ec3-86ef-3688d1aa762b already deleted. [ 848.548927] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a45625f2-6a96-4ec3-86ef-3688d1aa762b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.619205] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.619372] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.619995] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.619995] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.619995] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.619995] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42290a32-653b-4fbe-bf3c-54a980c12617 is going to be created. [ 848.621624] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.622650] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.622650] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.622650] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.622650] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.622650] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 is going to be updated. [ 848.623364] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.623525] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.623561] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.623704] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.623784] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.623876] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3a4718f-fd33-4499-98fb-1aa42d62f34c is going to be updated. [ 848.668577] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.668753] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.669192] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.669192] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.669317] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.672675] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.672934] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.672934] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.673127] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.673232] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.676597] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.679410] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.679410] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.679410] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.679410] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.683128] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42290a32-653b-4fbe-bf3c-54a980c12617 in Status: UNINITIALIZED for 2s [ 848.684911] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 in Status: IN_PROGRESS for 2s [ 848.685618] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3a4718f-fd33-4499-98fb-1aa42d62f34c in Status: IN_PROGRESS for 2s [ 848.860224] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 49dd754e-129e-49c8-9e52-09796cb64337: rpc.has_security_group_logging(os_id): False [ 848.878904] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.879160] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.879160] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.879363] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.879455] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.879642] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.879743] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.879822] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.879944] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.880031] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.880221] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.880364] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.880461] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.880605] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.880671] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.880896] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.881056] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.881161] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.881376] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.881497] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.881634] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49dd754e-129e-49c8-9e52-09796cb64337 is going to be updated. [ 848.963387] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.963387] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.963387] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.964969] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.965118] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.981947] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49dd754e-129e-49c8-9e52-09796cb64337 in Status: IN_PROGRESS for 2s [ 849.275284] env[70614]: INFO networking_nsxv3.common.synchronization [req-0b363ab9-43fa-4732-ba7f-e13eda6a12c3 req-83d8205d-dd97-4e9f-867f-3f166f862af3 tempest-SecurityGroupRulesTestJSON-1402624318 tempest-SecurityGroupRulesTestJSON-1402624318-project-member] Enqueued Resource ID: 8a777ead-dea8-4616-9817-798c52317f6a with Priority: HIGHEST for action security_group_rules [ 849.276055] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a777ead-dea8-4616-9817-798c52317f6a with Priority: HIGHEST for action security_group_rules [ 849.276451] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a777ead-dea8-4616-9817-798c52317f6a taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.276603] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a777ead-dea8-4616-9817-798c52317f6a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.276674] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a777ead-dea8-4616-9817-798c52317f6a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.276960] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a777ead-dea8-4616-9817-798c52317f6a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.277080] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a777ead-dea8-4616-9817-798c52317f6a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.676498] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c3a4718f-fd33-4499-98fb-1aa42d62f34c in Status: SUCCESS [ 849.676735] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c3a4718f-fd33-4499-98fb-1aa42d62f34c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.676911] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c3a4718f-fd33-4499-98fb-1aa42d62f34c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.677157] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c3a4718f-fd33-4499-98fb-1aa42d62f34c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.677249] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c3a4718f-fd33-4499-98fb-1aa42d62f34c',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.714764] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 in Status: SUCCESS [ 849.715027] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.716193] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.716423] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.716517] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1440acfc-c5d6-4a44-b0a8-654c4f16a7d1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.799185] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.799340] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.799388] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.799612] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.799727] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.799808] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a777ead-dea8-4616-9817-798c52317f6a already deleted. [ 849.799889] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a777ead-dea8-4616-9817-798c52317f6a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.179523] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3a4718f-fd33-4499-98fb-1aa42d62f34c taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.179673] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3a4718f-fd33-4499-98fb-1aa42d62f34c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.220285] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.220543] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.265458] env[70614]: INFO networking_nsxv3.common.synchronization [None req-ac5b92ba-5201-4cbf-8153-376554f9e938 None None] Enqueued Resource ID: 3c58a6a5-cff3-4157-a38e-6f1a294e0b36 with Priority: HIGHEST for action port [ 850.265724] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c58a6a5-cff3-4157-a38e-6f1a294e0b36 with Priority: HIGHEST for action port [ 850.266416] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-3c58a6a5-cff3-4157-a38e-6f1a294e0b36 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.266564] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3c58a6a5-cff3-4157-a38e-6f1a294e0b36" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.266564] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3c58a6a5-cff3-4157-a38e-6f1a294e0b36" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.266815] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3c58a6a5-cff3-4157-a38e-6f1a294e0b36" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.266892] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c58a6a5-cff3-4157-a38e-6f1a294e0b36',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.653591] env[70614]: INFO networking_nsxv3.common.synchronization [req-70aa0430-7e5a-4227-b65c-858a3e67af7b req-bb512177-ec43-4c4c-827e-d356565adeb3 tempest-SecurityGroupRulesTestJSON-1402624318 tempest-SecurityGroupRulesTestJSON-1402624318-project-member] Enqueued Resource ID: e209cc09-7b7c-4754-a70a-1dae96e0db6c with Priority: HIGHEST for action security_group_rules [ 850.653591] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e209cc09-7b7c-4754-a70a-1dae96e0db6c with Priority: HIGHEST for action security_group_rules [ 850.653591] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e209cc09-7b7c-4754-a70a-1dae96e0db6c taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.653591] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e209cc09-7b7c-4754-a70a-1dae96e0db6c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.653591] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e209cc09-7b7c-4754-a70a-1dae96e0db6c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.653591] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e209cc09-7b7c-4754-a70a-1dae96e0db6c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.653591] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e209cc09-7b7c-4754-a70a-1dae96e0db6c',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.703169] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42290a32-653b-4fbe-bf3c-54a980c12617 in Status: SUCCESS [ 850.703169] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42290a32-653b-4fbe-bf3c-54a980c12617" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.703169] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3a4718f-fd33-4499-98fb-1aa42d62f34c in Status: SUCCESS [ 850.703169] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3a4718f-fd33-4499-98fb-1aa42d62f34c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.703169] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 in Status: SUCCESS [ 850.703169] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.703586] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42290a32-653b-4fbe-bf3c-54a980c12617" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.703913] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42290a32-653b-4fbe-bf3c-54a980c12617" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.704279] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.704553] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.704710] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.705017] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.705241] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.705467] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('42290a32-653b-4fbe-bf3c-54a980c12617',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.706493] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3a4718f-fd33-4499-98fb-1aa42d62f34c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.706815] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3a4718f-fd33-4499-98fb-1aa42d62f34c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.707148] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.707406] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.707579] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.707814] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.707980] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.708203] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c3a4718f-fd33-4499-98fb-1aa42d62f34c',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.709147] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.709449] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.709714] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.709938] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.710103] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.712020] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.712020] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.712020] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1440acfc-c5d6-4a44-b0a8-654c4f16a7d1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.769103] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3c58a6a5-cff3-4157-a38e-6f1a294e0b36 [ 850.769349] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.769475] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.769554] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.769794] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.769849] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.769912] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3c58a6a5-cff3-4157-a38e-6f1a294e0b36 already deleted. [ 850.769991] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3c58a6a5-cff3-4157-a38e-6f1a294e0b36" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.004803] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49dd754e-129e-49c8-9e52-09796cb64337 in Status: SUCCESS [ 851.005417] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.011887] env[70614]: INFO networking_nsxv3.common.synchronization [req-f4183763-45d3-41d1-a69f-548f13a4f760 req-f0655e67-a591-4954-867a-7878bdd953ef tempest-SecurityGroupRulesTestJSON-1402624318 tempest-SecurityGroupRulesTestJSON-1402624318-project-member] Enqueued Resource ID: e209cc09-7b7c-4754-a70a-1dae96e0db6c with Priority: HIGHEST for action security_group_rules [ 851.013691] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e209cc09-7b7c-4754-a70a-1dae96e0db6c with Priority: HIGHEST for action security_group_rules [ 851.013691] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e209cc09-7b7c-4754-a70a-1dae96e0db6c taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.013691] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e209cc09-7b7c-4754-a70a-1dae96e0db6c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.124287] env[70614]: INFO networking_nsxv3.common.synchronization [req-9117bc16-f21f-48e1-9416-5b01a1354e85 req-00cbcbe2-ca64-4028-bbda-403d47021b3c tempest-SecurityGroupsTestJSON-818479832 tempest-SecurityGroupsTestJSON-818479832-project-member] Enqueued Resource ID: 42290a32-653b-4fbe-bf3c-54a980c12617 with Priority: HIGHEST for action security_group_members [ 851.124287] env[70614]: INFO networking_nsxv3.common.synchronization [req-9117bc16-f21f-48e1-9416-5b01a1354e85 req-00cbcbe2-ca64-4028-bbda-403d47021b3c tempest-SecurityGroupsTestJSON-818479832 tempest-SecurityGroupsTestJSON-818479832-project-member] Enqueued Resource ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 with Priority: HIGHEST for action security_group_members [ 851.126912] env[70614]: INFO networking_nsxv3.common.synchronization [req-9117bc16-f21f-48e1-9416-5b01a1354e85 req-00cbcbe2-ca64-4028-bbda-403d47021b3c tempest-SecurityGroupsTestJSON-818479832 tempest-SecurityGroupsTestJSON-818479832-project-member] Enqueued Resource ID: c3a4718f-fd33-4499-98fb-1aa42d62f34c with Priority: HIGHEST for action security_group_members [ 851.127947] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42290a32-653b-4fbe-bf3c-54a980c12617 with Priority: HIGHEST for action security_group_members [ 851.128357] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 with Priority: HIGHEST for action security_group_members [ 851.128629] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3a4718f-fd33-4499-98fb-1aa42d62f34c with Priority: HIGHEST for action security_group_members [ 851.129137] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-42290a32-653b-4fbe-bf3c-54a980c12617 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.129453] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42290a32-653b-4fbe-bf3c-54a980c12617" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.130305] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.130581] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.131613] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3a4718f-fd33-4499-98fb-1aa42d62f34c taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.132680] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3a4718f-fd33-4499-98fb-1aa42d62f34c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.184853] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.185241] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.185427] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.185752] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.185979] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.186358] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e209cc09-7b7c-4754-a70a-1dae96e0db6c already deleted. [ 851.186561] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e209cc09-7b7c-4754-a70a-1dae96e0db6c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.186837] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e209cc09-7b7c-4754-a70a-1dae96e0db6c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.187171] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e209cc09-7b7c-4754-a70a-1dae96e0db6c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.187368] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e209cc09-7b7c-4754-a70a-1dae96e0db6c',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.212554] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('42290a32-653b-4fbe-bf3c-54a980c12617',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.213582] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c3a4718f-fd33-4499-98fb-1aa42d62f34c',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.214892] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1440acfc-c5d6-4a44-b0a8-654c4f16a7d1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.260587] env[70614]: INFO networking_nsxv3.common.synchronization [None req-bbd5ed8d-fd7e-4636-9115-ba851a00c7dc None None] Enqueued Resource ID: 5808db66-cd3b-4a4f-a29b-ac504990d33a with Priority: HIGHEST for action port [ 851.263391] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5808db66-cd3b-4a4f-a29b-ac504990d33a with Priority: HIGHEST for action port [ 851.264743] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-5808db66-cd3b-4a4f-a29b-ac504990d33a taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.264943] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5808db66-cd3b-4a4f-a29b-ac504990d33a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.265083] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5808db66-cd3b-4a4f-a29b-ac504990d33a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.265447] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5808db66-cd3b-4a4f-a29b-ac504990d33a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.265571] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5808db66-cd3b-4a4f-a29b-ac504990d33a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.615400] env[70614]: INFO networking_nsxv3.common.synchronization [req-db6d50b6-443d-460c-84de-e45ff2555746 req-e277d0ad-9195-41b2-b0d3-87e62760cc3e tempest-SecurityGroupRulesTestJSON-1402624318 tempest-SecurityGroupRulesTestJSON-1402624318-project-member] Enqueued Resource ID: e209cc09-7b7c-4754-a70a-1dae96e0db6c with Priority: HIGHEST for action security_group_rules [ 851.616160] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e209cc09-7b7c-4754-a70a-1dae96e0db6c with Priority: HIGHEST for action security_group_rules [ 851.617073] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e209cc09-7b7c-4754-a70a-1dae96e0db6c taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.617073] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e209cc09-7b7c-4754-a70a-1dae96e0db6c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.708537] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.708902] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.708902] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.708984] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.709066] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.709163] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e209cc09-7b7c-4754-a70a-1dae96e0db6c already deleted. [ 851.709246] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e209cc09-7b7c-4754-a70a-1dae96e0db6c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.709428] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e209cc09-7b7c-4754-a70a-1dae96e0db6c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.709861] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e209cc09-7b7c-4754-a70a-1dae96e0db6c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.709861] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e209cc09-7b7c-4754-a70a-1dae96e0db6c',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.716536] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('42290a32-653b-4fbe-bf3c-54a980c12617',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.717857] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c3a4718f-fd33-4499-98fb-1aa42d62f34c',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.718947] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1440acfc-c5d6-4a44-b0a8-654c4f16a7d1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.769060] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5808db66-cd3b-4a4f-a29b-ac504990d33a [ 851.769203] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.769340] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.769411] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.769629] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.769719] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.769816] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5808db66-cd3b-4a4f-a29b-ac504990d33a already deleted. [ 851.769885] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5808db66-cd3b-4a4f-a29b-ac504990d33a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.138685] env[70614]: INFO networking_nsxv3.common.synchronization [None req-5c7ab43d-7013-494b-8dd9-0a8cca7a21d9 tempest-VolumesAdminNegativeTest-2045600642 tempest-VolumesAdminNegativeTest-2045600642-project-member] Enqueued Resource ID: b20ed1f0-7f46-40ac-882f-36a610d96a98 with Priority: HIGHEST for action security_group_rules [ 852.139419] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b20ed1f0-7f46-40ac-882f-36a610d96a98 with Priority: HIGHEST for action security_group_rules [ 852.140489] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b20ed1f0-7f46-40ac-882f-36a610d96a98 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.140701] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b20ed1f0-7f46-40ac-882f-36a610d96a98" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.140783] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b20ed1f0-7f46-40ac-882f-36a610d96a98" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.141069] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b20ed1f0-7f46-40ac-882f-36a610d96a98" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.141265] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b20ed1f0-7f46-40ac-882f-36a610d96a98',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.223586] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.223805] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.223891] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.224184] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.224278] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.224376] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3a4718f-fd33-4499-98fb-1aa42d62f34c is going to be updated. [ 852.225609] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.225759] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.225831] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.226037] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.226121] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.226203] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42290a32-653b-4fbe-bf3c-54a980c12617 is going to be updated. [ 852.227516] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.227619] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.227698] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.228403] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.228492] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.228597] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 is going to be updated. [ 852.231494] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.231636] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.231695] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.231845] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.231924] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.232024] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e209cc09-7b7c-4754-a70a-1dae96e0db6c already deleted. [ 852.233126] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e209cc09-7b7c-4754-a70a-1dae96e0db6c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.252530] env[70614]: INFO networking_nsxv3.common.synchronization [None req-bb7cf2bf-4ff9-4c9c-881f-2c7574b53db9 tempest-VolumesAdminNegativeTest-2045600642 tempest-VolumesAdminNegativeTest-2045600642-project-member] Enqueued Resource ID: b20ed1f0-7f46-40ac-882f-36a610d96a98 with Priority: HIGHEST for action security_group_rules [ 852.253135] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b20ed1f0-7f46-40ac-882f-36a610d96a98 with Priority: HIGHEST for action security_group_rules [ 852.254100] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b20ed1f0-7f46-40ac-882f-36a610d96a98 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.254100] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b20ed1f0-7f46-40ac-882f-36a610d96a98" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.261196] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.261390] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.261480] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.261789] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.262010] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.269094] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.269398] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.269743] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.269819] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.270789] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.272156] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.272156] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.272156] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.272358] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.272454] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.283668] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42290a32-653b-4fbe-bf3c-54a980c12617 in Status: IN_PROGRESS for 2s [ 852.284311] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 in Status: IN_PROGRESS for 2s [ 852.285013] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3a4718f-fd33-4499-98fb-1aa42d62f34c in Status: IN_PROGRESS for 2s [ 852.665713] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.666433] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.666548] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.666835] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.666941] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.667106] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b20ed1f0-7f46-40ac-882f-36a610d96a98 already deleted. [ 852.667187] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b20ed1f0-7f46-40ac-882f-36a610d96a98" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.667302] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b20ed1f0-7f46-40ac-882f-36a610d96a98" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.667468] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b20ed1f0-7f46-40ac-882f-36a610d96a98" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.667557] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b20ed1f0-7f46-40ac-882f-36a610d96a98',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.730209] env[70614]: INFO networking_nsxv3.common.synchronization [req-48ef799c-a6fd-47dd-a0a6-72d8f1f33d1a req-15df956f-c811-414e-9ae2-36325ae98246 tempest-ServerMetadataTestJSON-2044450732 tempest-ServerMetadataTestJSON-2044450732-project-member] Enqueued Resource ID: 8004bc6e-552e-4ff4-87f0-242b54bbfb5d with Priority: HIGHEST for action security_group_members [ 852.730723] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8004bc6e-552e-4ff4-87f0-242b54bbfb5d with Priority: HIGHEST for action security_group_members [ 852.731033] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-8004bc6e-552e-4ff4-87f0-242b54bbfb5d taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.731157] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8004bc6e-552e-4ff4-87f0-242b54bbfb5d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.731216] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8004bc6e-552e-4ff4-87f0-242b54bbfb5d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.731408] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8004bc6e-552e-4ff4-87f0-242b54bbfb5d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.731563] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.731659] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.731721] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.731862] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.731944] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.732167] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8004bc6e-552e-4ff4-87f0-242b54bbfb5d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.190466] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.190617] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.190694] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.190911] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.191012] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.191114] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b20ed1f0-7f46-40ac-882f-36a610d96a98 already deleted. [ 853.191216] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b20ed1f0-7f46-40ac-882f-36a610d96a98" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.234414] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.234672] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.234746] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.234977] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.235091] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.235395] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.235515] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.236249] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.236249] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.236249] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.236249] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8004bc6e-552e-4ff4-87f0-242b54bbfb5d is going to be updated. [ 853.264948] env[70614]: INFO networking_nsxv3.common.synchronization [req-cf0eb286-55db-4f21-8f6a-0ed540bf54e4 req-c9eb702a-0e7a-4969-b5bd-de4a1abe5f1a tempest-ServersAdminNegativeTestJSON-1410393069 tempest-ServersAdminNegativeTestJSON-1410393069-project-member] Enqueued Resource ID: e8c65e5a-d52c-481c-a6b2-680dae9a4593 with Priority: HIGHEST for action security_group_members [ 853.265734] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8c65e5a-d52c-481c-a6b2-680dae9a4593 with Priority: HIGHEST for action security_group_members [ 853.265878] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8c65e5a-d52c-481c-a6b2-680dae9a4593 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.265986] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8c65e5a-d52c-481c-a6b2-680dae9a4593" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.266282] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8c65e5a-d52c-481c-a6b2-680dae9a4593" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.266574] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8c65e5a-d52c-481c-a6b2-680dae9a4593" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.266743] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.266856] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.266901] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.267071] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.267158] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.268530] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e8c65e5a-d52c-481c-a6b2-680dae9a4593',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.277754] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.277754] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.277754] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.277984] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.277984] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.290043] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8004bc6e-552e-4ff4-87f0-242b54bbfb5d in Status: IN_PROGRESS for 2s [ 853.776985] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e8c65e5a-d52c-481c-a6b2-680dae9a4593',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.912126] env[70614]: INFO networking_nsxv3.common.synchronization [None req-94149b99-eb92-4e06-9c71-bfd4c3a45738 None None] Enqueued Resource ID: 7c2eca5d-7381-464f-bc41-9ef7b74db547 with Priority: HIGHEST for action port [ 853.912763] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c2eca5d-7381-464f-bc41-9ef7b74db547 with Priority: HIGHEST for action port [ 853.913435] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c2eca5d-7381-464f-bc41-9ef7b74db547 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.913773] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c2eca5d-7381-464f-bc41-9ef7b74db547" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.913908] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c2eca5d-7381-464f-bc41-9ef7b74db547" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.914282] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c2eca5d-7381-464f-bc41-9ef7b74db547" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.914488] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c2eca5d-7381-464f-bc41-9ef7b74db547',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.284435] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e8c65e5a-d52c-481c-a6b2-680dae9a4593',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.298643] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 in Status: SUCCESS [ 854.298643] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.302034] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42290a32-653b-4fbe-bf3c-54a980c12617 in Status: SUCCESS [ 854.302034] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42290a32-653b-4fbe-bf3c-54a980c12617" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.302034] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3a4718f-fd33-4499-98fb-1aa42d62f34c in Status: SUCCESS [ 854.302034] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3a4718f-fd33-4499-98fb-1aa42d62f34c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.306216] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.306216] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.306216] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.306216] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.306216] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.306216] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.306216] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.306216] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.306216] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1440acfc-c5d6-4a44-b0a8-654c4f16a7d1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.306216] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42290a32-653b-4fbe-bf3c-54a980c12617" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.306216] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42290a32-653b-4fbe-bf3c-54a980c12617" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.306216] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.306216] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.306216] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.306216] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.306216] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.306216] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42290a32-653b-4fbe-bf3c-54a980c12617" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.306216] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('42290a32-653b-4fbe-bf3c-54a980c12617',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.307078] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3a4718f-fd33-4499-98fb-1aa42d62f34c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.307078] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3a4718f-fd33-4499-98fb-1aa42d62f34c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.307078] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.307078] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.307078] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.307078] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.307312] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.307312] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3a4718f-fd33-4499-98fb-1aa42d62f34c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.307312] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c3a4718f-fd33-4499-98fb-1aa42d62f34c',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.308238] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.308392] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.308535] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.308633] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.308692] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.308824] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.308894] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.308972] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1440acfc-c5d6-4a44-b0a8-654c4f16a7d1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.309969] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42290a32-653b-4fbe-bf3c-54a980c12617" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.310092] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42290a32-653b-4fbe-bf3c-54a980c12617" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.310238] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.310332] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.310424] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.310521] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.310592] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.310669] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('42290a32-653b-4fbe-bf3c-54a980c12617',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.311289] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3a4718f-fd33-4499-98fb-1aa42d62f34c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.311447] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3a4718f-fd33-4499-98fb-1aa42d62f34c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.311587] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.311683] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.311782] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.311892] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.311948] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.312041] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c3a4718f-fd33-4499-98fb-1aa42d62f34c',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.418497] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7c2eca5d-7381-464f-bc41-9ef7b74db547 [ 854.418737] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.418870] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.418939] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.419260] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.419445] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.419445] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7c2eca5d-7381-464f-bc41-9ef7b74db547 already deleted. [ 854.419535] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c2eca5d-7381-464f-bc41-9ef7b74db547" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.789073] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.789073] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.789073] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.789073] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.789073] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.789527] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8c65e5a-d52c-481c-a6b2-680dae9a4593 is going to be updated. [ 854.809512] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('42290a32-653b-4fbe-bf3c-54a980c12617',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.811526] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.811720] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.814059] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.814186] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.814251] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.814451] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.814540] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.814726] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.814817] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.814882] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.815043] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.815125] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.815231] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42290a32-653b-4fbe-bf3c-54a980c12617 is going to be deleted. [ 854.816371] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1440acfc-c5d6-4a44-b0a8-654c4f16a7d1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.817215] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c3a4718f-fd33-4499-98fb-1aa42d62f34c',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.818598] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.818598] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.818598] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.818598] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.818598] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.818598] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.819063] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.819063] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.819063] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.819063] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.819063] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3a4718f-fd33-4499-98fb-1aa42d62f34c is going to be updated. [ 854.821368] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.821478] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.821546] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.822076] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.822225] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.837305] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8c65e5a-d52c-481c-a6b2-680dae9a4593 in Status: IN_PROGRESS for 2s [ 854.847776] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.847942] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.847942] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.848231] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.848558] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.856635] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.856635] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.856915] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.856915] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.856980] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.857110] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42290a32-653b-4fbe-bf3c-54a980c12617" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.858162] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3a4718f-fd33-4499-98fb-1aa42d62f34c in Status: IN_PROGRESS for 2s [ 855.303413] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8004bc6e-552e-4ff4-87f0-242b54bbfb5d in Status: SUCCESS [ 855.303631] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8004bc6e-552e-4ff4-87f0-242b54bbfb5d deletion is rescheduled due to dependency. [ 855.303752] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8004bc6e-552e-4ff4-87f0-242b54bbfb5d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.314525] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 42290a32-653b-4fbe-bf3c-54a980c12617: rpc.has_security_group_logging(os_id): False [ 855.324514] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1440acfc-c5d6-4a44-b0a8-654c4f16a7d1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.329192] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c3a4718f-fd33-4499-98fb-1aa42d62f34c: rpc.has_security_group_logging(os_id): False [ 855.344219] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.344650] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.344756] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.344994] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.345183] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.345348] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.345486] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.345736] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.345795] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.345839] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.345912] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 42290a32-653b-4fbe-bf3c-54a980c12617 is going to be created. [ 855.348549] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.348686] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.348738] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.348888] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.348965] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.349179] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.349283] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.349384] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.349486] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.349557] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.349640] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c3a4718f-fd33-4499-98fb-1aa42d62f34c is going to be updated. [ 855.371384] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/42290a32-653b-4fbe-bf3c-54a980c12617], does not exist path=[/infra/domains/default/groups/42290a32-653b-4fbe-bf3c-54a980c12617]."\n}' [ 855.371546] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 42290a32-653b-4fbe-bf3c-54a980c12617 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/42290a32-653b-4fbe-bf3c-54a980c12617 [ 855.371630] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 855.437751] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.437910] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.438575] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.438738] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.438909] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.441662] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.441790] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.441852] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.442046] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.443316] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.443586] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.443695] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.443757] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.443911] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.443987] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.444735] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.444809] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.444850] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.445155] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.445246] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.448166] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 42290a32-653b-4fbe-bf3c-54a980c12617 is going to be created. [ 855.461462] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c3a4718f-fd33-4499-98fb-1aa42d62f34c in Status: IN_PROGRESS for 2s [ 855.466455] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/42290a32-653b-4fbe-bf3c-54a980c12617], does not exist path=[/infra/domains/default/groups/42290a32-653b-4fbe-bf3c-54a980c12617]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/42290a32-653b-4fbe-bf3c-54a980c12617 [ 855.466612] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-42290a32-653b-4fbe-bf3c-54a980c12617" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.469035] env[70614]: Traceback (most recent call last): [ 855.469035] env[70614]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 855.469035] env[70614]: return func(*args, **kwargs) [ 855.469035] env[70614]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 855.469035] env[70614]: res.raise_for_status() [ 855.469035] env[70614]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 855.469035] env[70614]: raise HTTPError(http_error_msg, response=self) [ 855.469035] env[70614]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/42290a32-653b-4fbe-bf3c-54a980c12617 [ 855.469035] env[70614]: During handling of the above exception, another exception occurred: [ 855.469035] env[70614]: Traceback (most recent call last): [ 855.469035] env[70614]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 855.469035] env[70614]: listener.cb(fileno) [ 855.469035] env[70614]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 855.469035] env[70614]: result = function(*args, **kwargs) [ 855.469035] env[70614]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 855.469035] env[70614]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 855.469035] env[70614]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 855.469035] env[70614]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 855.469035] env[70614]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 855.469035] env[70614]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 855.469035] env[70614]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 855.469035] env[70614]: res.raise_for_status() [ 855.469035] env[70614]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 855.469035] env[70614]: raise HTTPError(http_error_msg, response=self) [ 855.469035] env[70614]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/42290a32-653b-4fbe-bf3c-54a980c12617 [ 855.469035] env[70614]: Removing descriptor: 26 [ 855.827706] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.828030] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.828030] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.828837] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.828951] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.829018] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 is going to be updated. [ 855.872666] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.872666] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.872666] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.872666] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.872666] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.882435] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 in Status: IN_PROGRESS for 2s [ 856.196123] env[70614]: INFO networking_nsxv3.common.synchronization [req-6053c459-015e-46eb-aeb4-b7311e4ec640 req-dd4f50d9-3484-4a1c-b2dc-7ad9327a28ef tempest-ServerTagsTestJSON-1172360736 tempest-ServerTagsTestJSON-1172360736-project-member] Enqueued Resource ID: 31d51b9f-24c2-407d-92f6-bfa0a20cfef8 with Priority: HIGHEST for action security_group_members [ 856.196866] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31d51b9f-24c2-407d-92f6-bfa0a20cfef8 with Priority: HIGHEST for action security_group_members [ 856.196969] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-31d51b9f-24c2-407d-92f6-bfa0a20cfef8 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.197096] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31d51b9f-24c2-407d-92f6-bfa0a20cfef8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.197166] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31d51b9f-24c2-407d-92f6-bfa0a20cfef8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.197375] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31d51b9f-24c2-407d-92f6-bfa0a20cfef8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.197536] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.197726] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.197726] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.197849] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.197936] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.198138] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('31d51b9f-24c2-407d-92f6-bfa0a20cfef8',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.703877] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.704055] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.704133] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.704361] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.737262] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.737262] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.737262] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.737798] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.741160] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.741160] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.741160] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31d51b9f-24c2-407d-92f6-bfa0a20cfef8 is going to be updated. [ 856.788249] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.788439] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.788509] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.792228] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.792228] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.800202] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31d51b9f-24c2-407d-92f6-bfa0a20cfef8 in Status: IN_PROGRESS for 2s [ 856.848128] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8c65e5a-d52c-481c-a6b2-680dae9a4593 in Status: SUCCESS [ 856.848524] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8c65e5a-d52c-481c-a6b2-680dae9a4593" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.867992] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3a4718f-fd33-4499-98fb-1aa42d62f34c in Status: SUCCESS [ 856.868297] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3a4718f-fd33-4499-98fb-1aa42d62f34c deletion is rescheduled due to dependency. [ 856.868425] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3a4718f-fd33-4499-98fb-1aa42d62f34c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.477407] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c3a4718f-fd33-4499-98fb-1aa42d62f34c in Status: SUCCESS [ 857.477644] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c3a4718f-fd33-4499-98fb-1aa42d62f34c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.896034] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 in Status: SUCCESS [ 857.896034] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.896034] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.896034] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.896034] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.896034] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.896034] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.896034] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.896034] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.896034] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.896034] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.896034] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.896034] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.896034] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.896034] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.896034] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.896034] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.896034] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.896034] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.897205] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.897205] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1440acfc-c5d6-4a44-b0a8-654c4f16a7d1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.399321] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1: rpc.has_security_group_logging(os_id): False [ 858.418191] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.418376] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.418448] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.418672] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.442981] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.443315] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.443628] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.443788] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.443999] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.444096] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.444289] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.444389] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.444446] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.444592] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.444665] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.444850] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.444942] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.445092] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.445944] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.446120] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.446238] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 is going to be updated. [ 858.520889] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.521014] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.521060] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.521276] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.521706] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.560991] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 in Status: IN_PROGRESS for 2s [ 858.811528] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31d51b9f-24c2-407d-92f6-bfa0a20cfef8 in Status: SUCCESS [ 858.811702] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31d51b9f-24c2-407d-92f6-bfa0a20cfef8 deletion is rescheduled due to dependency. [ 858.811818] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31d51b9f-24c2-407d-92f6-bfa0a20cfef8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.829047] env[70614]: INFO networking_nsxv3.common.synchronization [None req-05696a33-2f53-4a86-beb3-df81a8131616 None None] Enqueued Resource ID: 98c7bf4f-4e5b-4167-b17d-86c6fb1c9e8d with Priority: HIGHEST for action port [ 858.829322] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98c7bf4f-4e5b-4167-b17d-86c6fb1c9e8d with Priority: HIGHEST for action port [ 858.829891] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-98c7bf4f-4e5b-4167-b17d-86c6fb1c9e8d taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.830044] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-98c7bf4f-4e5b-4167-b17d-86c6fb1c9e8d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.830106] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-98c7bf4f-4e5b-4167-b17d-86c6fb1c9e8d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.830455] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-98c7bf4f-4e5b-4167-b17d-86c6fb1c9e8d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.830455] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98c7bf4f-4e5b-4167-b17d-86c6fb1c9e8d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.336620] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 98c7bf4f-4e5b-4167-b17d-86c6fb1c9e8d [ 859.336972] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.336972] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.337167] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.337543] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.337543] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.337543] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:98c7bf4f-4e5b-4167-b17d-86c6fb1c9e8d already deleted. [ 859.337543] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-98c7bf4f-4e5b-4167-b17d-86c6fb1c9e8d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.760279] env[70614]: INFO networking_nsxv3.common.synchronization [None req-6963b371-4ad3-4dae-848d-61d0e005792e tempest-AttachInterfacesUnderV243Test-10932585 tempest-AttachInterfacesUnderV243Test-10932585-project-member] Enqueued Resource ID: e744e9f1-b15c-4958-bd6f-1c34e15652a8 with Priority: HIGHEST for action security_group_rules [ 859.760887] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e744e9f1-b15c-4958-bd6f-1c34e15652a8 with Priority: HIGHEST for action security_group_rules [ 859.761210] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e744e9f1-b15c-4958-bd6f-1c34e15652a8 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.761722] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e744e9f1-b15c-4958-bd6f-1c34e15652a8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.761812] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e744e9f1-b15c-4958-bd6f-1c34e15652a8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.762136] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e744e9f1-b15c-4958-bd6f-1c34e15652a8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.762255] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e744e9f1-b15c-4958-bd6f-1c34e15652a8',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.892158] env[70614]: INFO networking_nsxv3.common.synchronization [None req-3cdbb21b-6446-4046-a522-7aaec64061e7 tempest-AttachInterfacesUnderV243Test-10932585 tempest-AttachInterfacesUnderV243Test-10932585-project-member] Enqueued Resource ID: e744e9f1-b15c-4958-bd6f-1c34e15652a8 with Priority: HIGHEST for action security_group_rules [ 859.893681] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e744e9f1-b15c-4958-bd6f-1c34e15652a8 with Priority: HIGHEST for action security_group_rules [ 859.893962] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e744e9f1-b15c-4958-bd6f-1c34e15652a8 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.896708] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e744e9f1-b15c-4958-bd6f-1c34e15652a8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.286902] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.286902] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.286902] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.286902] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.286902] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.286902] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e744e9f1-b15c-4958-bd6f-1c34e15652a8 already deleted. [ 860.286902] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e744e9f1-b15c-4958-bd6f-1c34e15652a8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.286902] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e744e9f1-b15c-4958-bd6f-1c34e15652a8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.286902] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e744e9f1-b15c-4958-bd6f-1c34e15652a8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.286902] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e744e9f1-b15c-4958-bd6f-1c34e15652a8',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.584731] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 in Status: SUCCESS [ 860.585184] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.813270] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.813725] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.813930] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.814259] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.814450] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.814637] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e744e9f1-b15c-4958-bd6f-1c34e15652a8 already deleted. [ 860.814800] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e744e9f1-b15c-4958-bd6f-1c34e15652a8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.514363] env[70614]: INFO networking_nsxv3.common.synchronization [None req-4b4d4c2f-bdd0-4412-a6b2-ed9d658b51e9 None None] Enqueued Resource ID: fb507f7d-fcd0-4bf9-9d85-0837c326f484 with Priority: HIGHEST for action port [ 861.514650] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb507f7d-fcd0-4bf9-9d85-0837c326f484 with Priority: HIGHEST for action port [ 861.515273] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb507f7d-fcd0-4bf9-9d85-0837c326f484 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.515403] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb507f7d-fcd0-4bf9-9d85-0837c326f484" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.515469] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb507f7d-fcd0-4bf9-9d85-0837c326f484" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.515799] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb507f7d-fcd0-4bf9-9d85-0837c326f484" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.515856] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb507f7d-fcd0-4bf9-9d85-0837c326f484',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.020611] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fb507f7d-fcd0-4bf9-9d85-0837c326f484 [ 862.021119] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.021331] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.021403] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.021606] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.021693] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.021789] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fb507f7d-fcd0-4bf9-9d85-0837c326f484 already deleted. [ 862.021867] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb507f7d-fcd0-4bf9-9d85-0837c326f484" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.205838] env[70614]: INFO networking_nsxv3.common.synchronization [None req-eed348e5-9925-410a-a85c-caf2aac85085 None None] Enqueued Resource ID: 03f0e9ae-f666-424d-a2fb-c5de4864e6d8 with Priority: HIGHEST for action port [ 862.206210] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03f0e9ae-f666-424d-a2fb-c5de4864e6d8 with Priority: HIGHEST for action port [ 862.206856] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-03f0e9ae-f666-424d-a2fb-c5de4864e6d8 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.206978] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-03f0e9ae-f666-424d-a2fb-c5de4864e6d8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.207067] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-03f0e9ae-f666-424d-a2fb-c5de4864e6d8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.207331] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-03f0e9ae-f666-424d-a2fb-c5de4864e6d8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.207418] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03f0e9ae-f666-424d-a2fb-c5de4864e6d8',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.275715] env[70614]: INFO networking_nsxv3.common.synchronization [req-fa82815f-e04c-4ddb-b21e-1420acfeca59 req-33e0df3e-3888-4bf3-b6eb-689355806446 tempest-ServerRescueTestJSON-1696153379 tempest-ServerRescueTestJSON-1696153379-project-member] Enqueued Resource ID: 0a55332f-b291-4614-8b34-ee4cd0d39027 with Priority: HIGHEST for action security_group_members [ 862.276276] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a55332f-b291-4614-8b34-ee4cd0d39027 with Priority: HIGHEST for action security_group_members [ 862.276602] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a55332f-b291-4614-8b34-ee4cd0d39027 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.276841] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.276841] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.277017] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.277173] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.277272] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.277272] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.277272] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.277272] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.277708] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a55332f-b291-4614-8b34-ee4cd0d39027',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.714866] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 03f0e9ae-f666-424d-a2fb-c5de4864e6d8 [ 862.715279] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.718856] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.718856] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.718856] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.718856] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.718856] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:03f0e9ae-f666-424d-a2fb-c5de4864e6d8 already deleted. [ 862.718856] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-03f0e9ae-f666-424d-a2fb-c5de4864e6d8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.780721] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a55332f-b291-4614-8b34-ee4cd0d39027',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.925013] env[70614]: INFO networking_nsxv3.common.synchronization [req-1748cbc5-b897-4bc9-8d86-a679ca4b7931 req-3c3fa2eb-c8f8-4897-9043-9b2d0def363c tempest-AttachInterfacesTestJSON-1919943007 tempest-AttachInterfacesTestJSON-1919943007-project-member] Enqueued Resource ID: 64d5aaad-612c-45e4-8c2c-8d390ad3ffdd with Priority: HIGHEST for action security_group_members [ 862.925556] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64d5aaad-612c-45e4-8c2c-8d390ad3ffdd with Priority: HIGHEST for action security_group_members [ 862.925857] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-64d5aaad-612c-45e4-8c2c-8d390ad3ffdd taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.925981] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64d5aaad-612c-45e4-8c2c-8d390ad3ffdd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.926851] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64d5aaad-612c-45e4-8c2c-8d390ad3ffdd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.927552] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64d5aaad-612c-45e4-8c2c-8d390ad3ffdd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.927732] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.927845] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.927911] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.928095] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.928216] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.928304] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64d5aaad-612c-45e4-8c2c-8d390ad3ffdd',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.286522] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a55332f-b291-4614-8b34-ee4cd0d39027',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.431899] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.432047] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.432124] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.432336] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.432458] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.432638] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.432753] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.432818] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.433017] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.433081] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.433163] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64d5aaad-612c-45e4-8c2c-8d390ad3ffdd already deleted. [ 863.433208] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64d5aaad-612c-45e4-8c2c-8d390ad3ffdd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.596370] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-385 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.596370] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-385" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.598245] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-385" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.598668] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-385" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.599199] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.599510] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.599748] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.600143] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.600422] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.600795] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 863.601167] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 863.601427] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 863.601637] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 863.601847] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 863.602075] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 863.602715] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 863.626522] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 863.626745] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 863.626928] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 863.627172] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-385" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.627546] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-d8256e46-2df3-4ad8-ad4b-5aa224ba13b0 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.628070] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-d8256e46-2df3-4ad8-ad4b-5aa224ba13b0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.628070] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-d8256e46-2df3-4ad8-ad4b-5aa224ba13b0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.628323] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-d8256e46-2df3-4ad8-ad4b-5aa224ba13b0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.628511] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8256e46-2df3-4ad8-ad4b-5aa224ba13b0',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.792239] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.792239] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.792239] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.792239] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.792239] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.792239] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a55332f-b291-4614-8b34-ee4cd0d39027 is going to be updated. [ 863.832442] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.832442] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.832442] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.832442] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.832442] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.841889] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a55332f-b291-4614-8b34-ee4cd0d39027 in Status: IN_PROGRESS for 2s [ 864.132734] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.132734] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.133152] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.133152] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.133368] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.133634] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port d8256e46-2df3-4ad8-ad4b-5aa224ba13b0 not found, creating... [ 864.134084] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.134282] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.134411] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.134669] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.134809] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.135118] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.135281] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.135399] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.135621] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.135901] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.135901] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: d8256e46-2df3-4ad8-ad4b-5aa224ba13b0 is going to be created. [ 864.162546] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.163967] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.163967] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.163967] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.163967] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.163967] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-d8256e46-2df3-4ad8-ad4b-5aa224ba13b0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.982213] env[70614]: INFO networking_nsxv3.common.synchronization [req-1748cbc5-b897-4bc9-8d86-a679ca4b7931 req-81ca4661-ce80-4648-af56-55dbc509d963 service nova] Enqueued Resource ID: 64d5aaad-612c-45e4-8c2c-8d390ad3ffdd with Priority: HIGHEST for action security_group_rules [ 864.982213] env[70614]: INFO networking_nsxv3.common.synchronization [req-1748cbc5-b897-4bc9-8d86-a679ca4b7931 req-81ca4661-ce80-4648-af56-55dbc509d963 service nova] Enqueued Resource ID: 64d5aaad-612c-45e4-8c2c-8d390ad3ffdd with Priority: HIGHEST for action security_group_members [ 864.982213] env[70614]: INFO networking_nsxv3.common.synchronization [req-1748cbc5-b897-4bc9-8d86-a679ca4b7931 req-81ca4661-ce80-4648-af56-55dbc509d963 service nova] Enqueued Resource ID: d8256e46-2df3-4ad8-ad4b-5aa224ba13b0 with Priority: HIGHEST for action port [ 864.982213] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64d5aaad-612c-45e4-8c2c-8d390ad3ffdd with Priority: HIGHEST for action security_group_rules [ 864.982213] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64d5aaad-612c-45e4-8c2c-8d390ad3ffdd with Priority: HIGHEST for action security_group_members [ 864.982213] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8256e46-2df3-4ad8-ad4b-5aa224ba13b0 with Priority: HIGHEST for action port [ 864.982845] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64d5aaad-612c-45e4-8c2c-8d390ad3ffdd taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.982845] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64d5aaad-612c-45e4-8c2c-8d390ad3ffdd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.982845] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64d5aaad-612c-45e4-8c2c-8d390ad3ffdd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.983269] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64d5aaad-612c-45e4-8c2c-8d390ad3ffdd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.983269] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64d5aaad-612c-45e4-8c2c-8d390ad3ffdd',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.984315] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-64d5aaad-612c-45e4-8c2c-8d390ad3ffdd taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.984315] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64d5aaad-612c-45e4-8c2c-8d390ad3ffdd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.984315] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64d5aaad-612c-45e4-8c2c-8d390ad3ffdd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.984315] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64d5aaad-612c-45e4-8c2c-8d390ad3ffdd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.984485] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.984536] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.984585] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.984958] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.984958] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.984958] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64d5aaad-612c-45e4-8c2c-8d390ad3ffdd',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.985951] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-d8256e46-2df3-4ad8-ad4b-5aa224ba13b0 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.985951] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d8256e46-2df3-4ad8-ad4b-5aa224ba13b0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.985951] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d8256e46-2df3-4ad8-ad4b-5aa224ba13b0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.985951] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d8256e46-2df3-4ad8-ad4b-5aa224ba13b0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.985951] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8256e46-2df3-4ad8-ad4b-5aa224ba13b0',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.487392] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('64d5aaad-612c-45e4-8c2c-8d390ad3ffdd',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.488508] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-64d5aaad-612c-45e4-8c2c-8d390ad3ffdd taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.488623] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64d5aaad-612c-45e4-8c2c-8d390ad3ffdd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.491210] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d8256e46-2df3-4ad8-ad4b-5aa224ba13b0 with status ACTIVE [ 865.491437] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.491566] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.491631] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.491841] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.491929] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.492121] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.492219] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.492276] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.492427] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.492503] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.492714] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.492813] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.492941] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.493008] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.493080] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.493211] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d8256e46-2df3-4ad8-ad4b-5aa224ba13b0 is going to be updated. [ 865.529023] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.529219] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.529330] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.529551] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.529971] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.530790] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d8256e46-2df3-4ad8-ad4b-5aa224ba13b0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.587215] env[70614]: INFO networking_nsxv3.common.synchronization [req-907c4258-d9fd-41c7-bf71-56150489aa30 req-5c7d65d2-d4a8-4217-a028-4554958fe01b tempest-ServersWithSpecificFlavorTestJSON-1815410269 tempest-ServersWithSpecificFlavorTestJSON-1815410269-project-member] Enqueued Resource ID: ca9b1416-779b-4bc5-ae29-5117ebb9bc1a with Priority: HIGHEST for action security_group_members [ 865.587730] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca9b1416-779b-4bc5-ae29-5117ebb9bc1a with Priority: HIGHEST for action security_group_members [ 865.588024] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.588145] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.588228] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.588433] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.588589] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.588688] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.588742] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.588891] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.588970] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.589904] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca9b1416-779b-4bc5-ae29-5117ebb9bc1a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.853565] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a55332f-b291-4614-8b34-ee4cd0d39027 in Status: SUCCESS [ 865.853565] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.960122] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-996 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.962098] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-996" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.962308] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-996" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.962594] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-996" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.962885] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.963850] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.963850] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.963850] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.963850] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.963850] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 865.964196] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 865.964196] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 865.964196] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 865.964343] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 865.964474] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 865.964616] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 865.984132] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 865.984421] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 865.984498] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 865.984611] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-996" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.985031] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-d8c25d00-3307-4c08-a18e-c8957a91f0bd taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.985224] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-d8c25d00-3307-4c08-a18e-c8957a91f0bd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.985392] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-d8c25d00-3307-4c08-a18e-c8957a91f0bd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.985661] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-d8c25d00-3307-4c08-a18e-c8957a91f0bd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.986677] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8c25d00-3307-4c08-a18e-c8957a91f0bd',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.989717] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('64d5aaad-612c-45e4-8c2c-8d390ad3ffdd',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.092700] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.092842] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.092926] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.093147] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.115323] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.115583] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.115866] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.116033] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.116319] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.116491] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.116676] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca9b1416-779b-4bc5-ae29-5117ebb9bc1a is going to be updated. [ 866.146524] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.146524] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.146524] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.146524] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.146524] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.157455] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca9b1416-779b-4bc5-ae29-5117ebb9bc1a in Status: IN_PROGRESS for 2s [ 866.488488] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.488756] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.488846] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.489158] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.489326] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.489482] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port d8c25d00-3307-4c08-a18e-c8957a91f0bd not found, creating... [ 866.489743] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.490362] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.490362] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.490362] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.490362] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.490689] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.490945] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.490945] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.492027] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.492027] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.492027] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: d8c25d00-3307-4c08-a18e-c8957a91f0bd is going to be created. [ 866.493116] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.493116] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.493116] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.493116] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.493116] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.493116] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64d5aaad-612c-45e4-8c2c-8d390ad3ffdd is going to be created. [ 866.513825] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.513825] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.513825] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.514142] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.514380] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.514608] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-d8c25d00-3307-4c08-a18e-c8957a91f0bd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.523477] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.523632] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.523684] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.524386] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.524386] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.535442] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64d5aaad-612c-45e4-8c2c-8d390ad3ffdd in Status: UNINITIALIZED for 2s [ 867.243193] env[70614]: INFO networking_nsxv3.common.synchronization [req-907c4258-d9fd-41c7-bf71-56150489aa30 req-37bc44d6-878e-42b2-96e0-70deb8d7c86e service nova] Enqueued Resource ID: ca9b1416-779b-4bc5-ae29-5117ebb9bc1a with Priority: HIGHEST for action security_group_rules [ 867.243664] env[70614]: INFO networking_nsxv3.common.synchronization [req-907c4258-d9fd-41c7-bf71-56150489aa30 req-37bc44d6-878e-42b2-96e0-70deb8d7c86e service nova] Enqueued Resource ID: ca9b1416-779b-4bc5-ae29-5117ebb9bc1a with Priority: HIGHEST for action security_group_members [ 867.244187] env[70614]: INFO networking_nsxv3.common.synchronization [req-907c4258-d9fd-41c7-bf71-56150489aa30 req-37bc44d6-878e-42b2-96e0-70deb8d7c86e service nova] Enqueued Resource ID: d8c25d00-3307-4c08-a18e-c8957a91f0bd with Priority: HIGHEST for action port [ 867.244492] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca9b1416-779b-4bc5-ae29-5117ebb9bc1a with Priority: HIGHEST for action security_group_rules [ 867.244724] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca9b1416-779b-4bc5-ae29-5117ebb9bc1a with Priority: HIGHEST for action security_group_members [ 867.244926] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8c25d00-3307-4c08-a18e-c8957a91f0bd with Priority: HIGHEST for action port [ 867.245238] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.245419] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.245526] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.245781] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.245876] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca9b1416-779b-4bc5-ae29-5117ebb9bc1a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.246991] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.248103] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.248103] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-d8c25d00-3307-4c08-a18e-c8957a91f0bd taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.248103] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d8c25d00-3307-4c08-a18e-c8957a91f0bd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.248103] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d8c25d00-3307-4c08-a18e-c8957a91f0bd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.248103] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d8c25d00-3307-4c08-a18e-c8957a91f0bd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.248103] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8c25d00-3307-4c08-a18e-c8957a91f0bd',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.750471] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.750756] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.751011] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d8c25d00-3307-4c08-a18e-c8957a91f0bd with status ACTIVE [ 867.751237] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.751389] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.751485] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.751725] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.751850] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.752089] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.752231] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.752324] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.752513] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.752627] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.752840] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.752969] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.753068] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.753241] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.754169] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.754278] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d8c25d00-3307-4c08-a18e-c8957a91f0bd is going to be updated. [ 867.776851] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.777065] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.777065] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.777268] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.777404] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.777559] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d8c25d00-3307-4c08-a18e-c8957a91f0bd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.064034] env[70614]: INFO networking_nsxv3.common.synchronization [req-0548a424-9917-4634-8dd9-bc6ec2564f42 req-a76656c1-6616-4e26-9309-3610072602ec tempest-ServersAdminTestJSON-365827888 tempest-ServersAdminTestJSON-365827888-project-member] Enqueued Resource ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b with Priority: HIGHEST for action security_group_members [ 868.064034] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b with Priority: HIGHEST for action security_group_members [ 868.064034] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.064034] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.064034] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.064034] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.064034] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.064034] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.064426] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.064426] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.064426] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.064426] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.166325] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca9b1416-779b-4bc5-ae29-5117ebb9bc1a in Status: SUCCESS [ 868.166325] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca9b1416-779b-4bc5-ae29-5117ebb9bc1a deletion is rescheduled due to dependency. [ 868.166325] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.166564] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.166722] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.166903] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.167026] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.167089] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.167240] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.167320] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.167413] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca9b1416-779b-4bc5-ae29-5117ebb9bc1a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.477353] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-746 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.477679] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-746" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.477679] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-746" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.477905] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-746" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.478166] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.478344] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.478463] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.478675] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.478813] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.481035] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 868.481035] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 868.481035] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 868.481035] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 868.481035] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 868.481035] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 868.481035] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 868.502379] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 868.502379] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 868.502379] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 868.502379] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-746" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.502615] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-4db556ee-f389-412d-89d9-0dcf0a76fdec taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.502796] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-4db556ee-f389-412d-89d9-0dcf0a76fdec" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.502851] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-4db556ee-f389-412d-89d9-0dcf0a76fdec" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.503160] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-4db556ee-f389-412d-89d9-0dcf0a76fdec" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.503324] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4db556ee-f389-412d-89d9-0dcf0a76fdec',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.548466] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64d5aaad-612c-45e4-8c2c-8d390ad3ffdd in Status: SUCCESS [ 868.548690] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64d5aaad-612c-45e4-8c2c-8d390ad3ffdd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.548858] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64d5aaad-612c-45e4-8c2c-8d390ad3ffdd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.549083] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64d5aaad-612c-45e4-8c2c-8d390ad3ffdd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.549314] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.549430] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.549495] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.549655] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.549736] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.549820] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64d5aaad-612c-45e4-8c2c-8d390ad3ffdd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.549976] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('64d5aaad-612c-45e4-8c2c-8d390ad3ffdd',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.567093] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.670441] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca9b1416-779b-4bc5-ae29-5117ebb9bc1a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.005700] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.006143] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.006294] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.006586] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.006751] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.006894] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 4db556ee-f389-412d-89d9-0dcf0a76fdec not found, creating... [ 869.007429] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.007630] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.007736] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.007974] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.008116] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.008529] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.008708] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.008846] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.009217] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.009488] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.009602] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 4db556ee-f389-412d-89d9-0dcf0a76fdec is going to be created. [ 869.038715] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.039048] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.039173] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.039610] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.039961] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.040303] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-4db556ee-f389-412d-89d9-0dcf0a76fdec" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.052336] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('64d5aaad-612c-45e4-8c2c-8d390ad3ffdd',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.072686] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.172838] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca9b1416-779b-4bc5-ae29-5117ebb9bc1a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.557994] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 64d5aaad-612c-45e4-8c2c-8d390ad3ffdd: rpc.has_security_group_logging(os_id): False [ 869.575328] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.575552] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.575552] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.575730] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.575820] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.575920] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b is going to be updated. [ 869.577970] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.578134] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.578183] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.578398] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.579030] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.579030] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.579030] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.579030] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.579317] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.579317] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.579317] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64d5aaad-612c-45e4-8c2c-8d390ad3ffdd is going to be created. [ 869.618070] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.618352] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.618352] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.618570] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.618801] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.630806] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b in Status: IN_PROGRESS for 2s [ 869.661045] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.661045] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.661045] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.661045] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.661045] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.671493] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64d5aaad-612c-45e4-8c2c-8d390ad3ffdd in Status: IN_PROGRESS for 2s [ 869.676628] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.676836] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.676912] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.677215] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.677318] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.677455] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca9b1416-779b-4bc5-ae29-5117ebb9bc1a is going to be updated. [ 869.757136] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.757416] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.757497] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.757789] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.758141] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.780781] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca9b1416-779b-4bc5-ae29-5117ebb9bc1a in Status: IN_PROGRESS for 2s [ 870.115146] env[70614]: INFO networking_nsxv3.common.synchronization [req-0548a424-9917-4634-8dd9-bc6ec2564f42 req-21a72533-ddab-4c89-af66-91f73d136365 service nova] Enqueued Resource ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b with Priority: HIGHEST for action security_group_rules [ 870.115146] env[70614]: INFO networking_nsxv3.common.synchronization [req-0548a424-9917-4634-8dd9-bc6ec2564f42 req-21a72533-ddab-4c89-af66-91f73d136365 service nova] Enqueued Resource ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b with Priority: HIGHEST for action security_group_members [ 870.115146] env[70614]: INFO networking_nsxv3.common.synchronization [req-0548a424-9917-4634-8dd9-bc6ec2564f42 req-21a72533-ddab-4c89-af66-91f73d136365 service nova] Enqueued Resource ID: 4db556ee-f389-412d-89d9-0dcf0a76fdec with Priority: HIGHEST for action port [ 870.115146] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b with Priority: HIGHEST for action security_group_rules [ 870.115146] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b with Priority: HIGHEST for action security_group_members [ 870.115146] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4db556ee-f389-412d-89d9-0dcf0a76fdec with Priority: HIGHEST for action port [ 870.121376] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.121376] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.121376] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.121376] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.121376] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.124048] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.124048] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.124048] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-4db556ee-f389-412d-89d9-0dcf0a76fdec taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.124048] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4db556ee-f389-412d-89d9-0dcf0a76fdec" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.124048] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4db556ee-f389-412d-89d9-0dcf0a76fdec" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.124500] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4db556ee-f389-412d-89d9-0dcf0a76fdec" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.124500] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4db556ee-f389-412d-89d9-0dcf0a76fdec',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.627029] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.627029] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.629841] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4db556ee-f389-412d-89d9-0dcf0a76fdec with status ACTIVE [ 870.630074] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.630203] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.630269] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.630477] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.630565] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.630741] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.631915] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.631915] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.631915] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.631915] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.631915] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.631915] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.631915] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.632184] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.632184] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.632257] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4db556ee-f389-412d-89d9-0dcf0a76fdec is going to be updated. [ 870.657924] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.658179] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.658179] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.658453] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.658600] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.658759] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4db556ee-f389-412d-89d9-0dcf0a76fdec" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.848856] env[70614]: INFO networking_nsxv3.common.synchronization [req-676a66d1-fce9-411a-97a0-f71fdbba0850 req-679fc571-ee2e-44dc-b738-c7c00671eb66 tempest-ImagesOneServerNegativeTestJSON-1769697081 tempest-ImagesOneServerNegativeTestJSON-1769697081-project-member] Enqueued Resource ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e with Priority: HIGHEST for action security_group_members [ 870.850095] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e with Priority: HIGHEST for action security_group_members [ 870.850455] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-3060abf5-a0d6-4fce-88da-15f03f632b6e taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.850614] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.850701] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.850951] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.851117] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.851220] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.851284] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.851485] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.851596] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.851714] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3060abf5-a0d6-4fce-88da-15f03f632b6e',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.356727] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.356727] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.356727] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.356727] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.381331] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.381331] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.381331] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.381331] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.381331] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.381331] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.381331] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e is going to be updated. [ 871.411625] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.411625] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.411625] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.411625] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.411625] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.427529] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e in Status: IN_PROGRESS for 2s [ 871.457146] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-720 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.457362] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-720" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.457490] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-720" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.457761] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-720" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.458048] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.458212] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.458358] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.458580] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.458725] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.458933] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 871.459753] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 871.459948] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 871.460223] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 871.461194] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 871.461364] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 871.461524] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 871.481386] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 871.481556] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 871.482015] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 871.482015] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-720" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.482333] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-31a717d9-0fe0-4ce0-ae35-2bcb9b9e488a taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.482548] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-31a717d9-0fe0-4ce0-ae35-2bcb9b9e488a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.482708] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-31a717d9-0fe0-4ce0-ae35-2bcb9b9e488a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.483065] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-31a717d9-0fe0-4ce0-ae35-2bcb9b9e488a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.483262] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31a717d9-0fe0-4ce0-ae35-2bcb9b9e488a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.645172] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b in Status: SUCCESS [ 871.645589] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.645589] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.645787] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.645966] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.646098] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.646183] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.646318] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.646401] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.646488] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.696120] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64d5aaad-612c-45e4-8c2c-8d390ad3ffdd in Status: SUCCESS [ 871.696710] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64d5aaad-612c-45e4-8c2c-8d390ad3ffdd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.791114] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca9b1416-779b-4bc5-ae29-5117ebb9bc1a in Status: SUCCESS [ 871.792031] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.792031] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.792031] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.792031] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.792031] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.792335] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.792335] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.792439] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.792553] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.792653] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ca9b1416-779b-4bc5-ae29-5117ebb9bc1a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.986935] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.987055] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.987222] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.987565] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.987762] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.988052] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 31a717d9-0fe0-4ce0-ae35-2bcb9b9e488a not found, creating... [ 871.988381] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.988598] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.988755] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.989075] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.989209] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.989544] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.989719] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.989861] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.990041] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.990179] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.990319] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 31a717d9-0fe0-4ce0-ae35-2bcb9b9e488a is going to be created. [ 872.013515] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.013771] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.013920] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.014265] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.014612] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.014821] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-31a717d9-0fe0-4ce0-ae35-2bcb9b9e488a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.149547] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.224325] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.224325] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.224325] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.224325] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.224325] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.295603] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ca9b1416-779b-4bc5-ae29-5117ebb9bc1a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.654462] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.726630] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.772365] env[70614]: INFO networking_nsxv3.common.synchronization [req-676a66d1-fce9-411a-97a0-f71fdbba0850 req-cacda182-81cc-4646-bc67-9841634c6866 service nova] Enqueued Resource ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e with Priority: HIGHEST for action security_group_rules [ 872.772631] env[70614]: INFO networking_nsxv3.common.synchronization [req-676a66d1-fce9-411a-97a0-f71fdbba0850 req-cacda182-81cc-4646-bc67-9841634c6866 service nova] Enqueued Resource ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e with Priority: HIGHEST for action security_group_members [ 872.772821] env[70614]: INFO networking_nsxv3.common.synchronization [req-676a66d1-fce9-411a-97a0-f71fdbba0850 req-cacda182-81cc-4646-bc67-9841634c6866 service nova] Enqueued Resource ID: 31a717d9-0fe0-4ce0-ae35-2bcb9b9e488a with Priority: HIGHEST for action port [ 872.773088] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e with Priority: HIGHEST for action security_group_rules [ 872.773226] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e with Priority: HIGHEST for action security_group_members [ 872.773333] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31a717d9-0fe0-4ce0-ae35-2bcb9b9e488a with Priority: HIGHEST for action port [ 872.773917] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3060abf5-a0d6-4fce-88da-15f03f632b6e taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.774143] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.774240] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.774478] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.774590] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3060abf5-a0d6-4fce-88da-15f03f632b6e',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.775456] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-3060abf5-a0d6-4fce-88da-15f03f632b6e taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.775947] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.776209] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-31a717d9-0fe0-4ce0-ae35-2bcb9b9e488a taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.776371] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31a717d9-0fe0-4ce0-ae35-2bcb9b9e488a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.776478] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31a717d9-0fe0-4ce0-ae35-2bcb9b9e488a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.776653] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31a717d9-0fe0-4ce0-ae35-2bcb9b9e488a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.776753] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31a717d9-0fe0-4ce0-ae35-2bcb9b9e488a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.797751] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ca9b1416-779b-4bc5-ae29-5117ebb9bc1a: rpc.has_security_group_logging(os_id): False [ 872.815810] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.816357] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.816357] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.816357] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.816357] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.816549] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.816650] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.816712] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.816855] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.816932] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.817024] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca9b1416-779b-4bc5-ae29-5117ebb9bc1a is going to be updated. [ 872.874477] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.874639] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.874768] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.874981] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.875483] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.886324] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca9b1416-779b-4bc5-ae29-5117ebb9bc1a in Status: IN_PROGRESS for 2s [ 873.158199] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.158199] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.158199] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.158199] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.158199] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.158199] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b is going to be updated. [ 873.189070] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.189245] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.189319] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.189548] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.189710] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.210286] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b in Status: IN_PROGRESS for 2s [ 873.228981] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.278137] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-3060abf5-a0d6-4fce-88da-15f03f632b6e taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.278327] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.279646] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 31a717d9-0fe0-4ce0-ae35-2bcb9b9e488a with status ACTIVE [ 873.279826] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.279942] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.280013] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.280235] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.280551] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.280551] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.280734] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.280734] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.280799] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.280898] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.281068] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.281156] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.281210] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.281383] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.281471] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.281559] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 31a717d9-0fe0-4ce0-ae35-2bcb9b9e488a is going to be updated. [ 873.314922] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.315235] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.315235] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.315451] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.315502] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.315660] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31a717d9-0fe0-4ce0-ae35-2bcb9b9e488a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.407854] env[70614]: INFO networking_nsxv3.common.synchronization [req-2b3a4b1a-3710-4cf7-8778-3637cf8f3039 req-1487f0cf-66ca-4384-9d40-1c8253dac11d tempest-ImagesTestJSON-1765947257 tempest-ImagesTestJSON-1765947257-project-member] Enqueued Resource ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 with Priority: HIGHEST for action security_group_members [ 873.408572] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 with Priority: HIGHEST for action security_group_members [ 873.408950] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-04a082fe-52f7-4ac6-a12b-63791c63be86 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.409124] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.409246] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.409484] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.409743] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.409880] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.409970] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.410225] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.410331] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.410432] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04a082fe-52f7-4ac6-a12b-63791c63be86',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.436639] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e in Status: SUCCESS [ 873.436821] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e deletion is rescheduled due to dependency. [ 873.436933] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.437423] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.437683] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.437876] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.437997] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.438085] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.438276] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.438367] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.438467] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3060abf5-a0d6-4fce-88da-15f03f632b6e',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.732422] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 873.732707] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 873.912343] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.912623] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.913050] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.913369] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.918360] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-12 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.918582] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-12" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.918707] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-12" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.919050] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-12" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.919354] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.919519] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.919632] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.919842] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.919978] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.920211] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 873.922029] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 873.922029] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 873.922029] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 873.922029] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 873.922029] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 873.922029] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 873.940672] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3060abf5-a0d6-4fce-88da-15f03f632b6e',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.942909] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 873.943736] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 873.944020] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 873.944465] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-12" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.944777] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-6aa811e4-35d4-4df0-8891-d02b73b2c96d taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.945033] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-6aa811e4-35d4-4df0-8891-d02b73b2c96d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.945197] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-6aa811e4-35d4-4df0-8891-d02b73b2c96d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.945604] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-6aa811e4-35d4-4df0-8891-d02b73b2c96d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.945804] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6aa811e4-35d4-4df0-8891-d02b73b2c96d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.948638] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.949011] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.949117] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.949157] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.949380] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.949480] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.949754] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 is going to be updated. [ 873.990273] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.990273] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.990273] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.990424] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.990537] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.000647] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 in Status: IN_PROGRESS for 2s [ 874.451028] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3060abf5-a0d6-4fce-88da-15f03f632b6e',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.451028] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.451028] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.451028] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.451028] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.451028] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.451028] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 6aa811e4-35d4-4df0-8891-d02b73b2c96d not found, creating... [ 874.451028] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.451028] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.451028] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.451028] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.451963] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.452522] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.452888] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.453132] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.453460] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.453977] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.454255] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 6aa811e4-35d4-4df0-8891-d02b73b2c96d is going to be created. [ 874.477365] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.477365] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.477365] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.477365] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.477365] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.477365] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-6aa811e4-35d4-4df0-8891-d02b73b2c96d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.779614] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.779973] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.779973] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.780164] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.798417] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 874.799354] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.800535] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 874.830587] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.830827] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.830827] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.831020] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.838631] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.839254] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 874.839365] env[70614]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=70614) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 874.839481] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 874.890873] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.891096] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.891096] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.891342] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.892374] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.892374] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 874.911085] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca9b1416-779b-4bc5-ae29-5117ebb9bc1a in Status: SUCCESS [ 874.911085] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.960816] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.960816] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.960816] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.960816] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.960816] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.960816] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e is going to be updated. [ 874.983460] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.983688] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.983688] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.983903] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.984119] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.984391] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 875.019782] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.020033] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.020033] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.020251] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.020380] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.035969] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e in Status: IN_PROGRESS for 2s [ 875.090214] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.090506] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.090506] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.090698] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.090828] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.095028] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:36. [ 875.095028] env[70614]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'4e54f39e-349d-49ad-bb07-348488d846f0', 'c3a4718f-fd33-4499-98fb-1aa42d62f34c', '49dd754e-129e-49c8-9e52-09796cb64337', 'f21a3b6e-da5e-4c92-8717-c114952a5767', 'abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b', '3060abf5-a0d6-4fce-88da-15f03f632b6e', '05ee2574-9125-4ff3-8197-e0eb7f0c45f2', '0a55332f-b291-4614-8b34-ee4cd0d39027', '428bc8ce-d8af-4c27-9ff7-291210f88a0a', '64d5aaad-612c-45e4-8c2c-8d390ad3ffdd', 'df8f20f5-6e92-4ac4-bdd2-05863ac4905f', '6d3a5ad0-c473-4d61-9101-9c7582c27390', '6b7b9850-41ce-4284-a095-b60375661eb1', '327db6cf-92fa-437c-b166-c5060f6230e2', 'e8c9194b-5e05-4207-a5ab-784203682b19', 'ebcad34a-a932-4aaf-93de-b0493166d0cf', '0d6e05da-2389-460c-a38a-c95fe0a87162', '55f254c4-5a5d-440f-958c-5fd96778e473', '04a082fe-52f7-4ac6-a12b-63791c63be86', 'ca9b1416-779b-4bc5-ae29-5117ebb9bc1a', '954d5d18-f5f4-41ee-a496-48e087a4b527', '3177f360-f74b-456a-9c1b-681726056f53', '31d51b9f-24c2-407d-92f6-bfa0a20cfef8', '81470f34-f44d-4111-b9a8-fc43c119e1dd', 'e23923e3-0ade-47cf-aa89-03f9a991b3f7', '03fa4ca9-532b-43b0-bd53-de11eea0a016', '2db7d87e-43a6-451c-9080-385c174466ee', '8004bc6e-552e-4ff4-87f0-242b54bbfb5d', '336e562f-9c8e-4021-953e-5756518b10b0', '1440acfc-c5d6-4a44-b0a8-654c4f16a7d1', '406660af-f92d-476c-ab5f-e3168c58847d', 'ecaff113-395f-46a3-b8a5-a3ce5cb003a5', 'ec4cc5da-964e-43e8-9531-6581ec387b4d', 'e8c65e5a-d52c-481c-a6b2-680dae9a4593', 'f0060547-03fb-4d1a-ad8e-69519760b908', '63a56402-3dcf-44d4-b33d-a56ff531a12c'} {{(pid=70614) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 875.095028] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 875.126730] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.126730] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.126730] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.126958] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.127027] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.127132] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 875.127202] env[70614]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=70614) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 875.127286] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 875.227051] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b in Status: SUCCESS [ 875.227341] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.227526] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.227769] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.227986] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.228133] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.228201] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.228401] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.228490] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.228565] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.228658] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.249551] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.249788] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.249847] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.250289] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.251121] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.251390] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 875.251482] env[70614]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=70614) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 875.251531] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 875.251594] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 875.251668] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/36 resources of Type:Security Group Rules [ 875.251734] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4e54f39e-349d-49ad-bb07-348488d846f0 with Priority: HIGH for action security_group_rules [ 875.251808] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c3a4718f-fd33-4499-98fb-1aa42d62f34c with Priority: HIGH for action security_group_rules [ 875.251871] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 49dd754e-129e-49c8-9e52-09796cb64337 with Priority: HIGH for action security_group_rules [ 875.251929] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f21a3b6e-da5e-4c92-8717-c114952a5767 with Priority: HIGH for action security_group_rules [ 875.251989] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b with Priority: HIGH for action security_group_rules [ 875.252072] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e with Priority: HIGH for action security_group_rules [ 875.252124] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 05ee2574-9125-4ff3-8197-e0eb7f0c45f2 with Priority: HIGH for action security_group_rules [ 875.253183] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0a55332f-b291-4614-8b34-ee4cd0d39027 with Priority: HIGH for action security_group_rules [ 875.253183] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 428bc8ce-d8af-4c27-9ff7-291210f88a0a with Priority: HIGH for action security_group_rules [ 875.253183] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 64d5aaad-612c-45e4-8c2c-8d390ad3ffdd with Priority: HIGH for action security_group_rules [ 875.253183] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f with Priority: HIGH for action security_group_rules [ 875.253183] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 with Priority: HIGH for action security_group_rules [ 875.253183] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6b7b9850-41ce-4284-a095-b60375661eb1 with Priority: HIGH for action security_group_rules [ 875.253183] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 327db6cf-92fa-437c-b166-c5060f6230e2 with Priority: HIGH for action security_group_rules [ 875.253183] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e8c9194b-5e05-4207-a5ab-784203682b19 with Priority: HIGH for action security_group_rules [ 875.253183] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ebcad34a-a932-4aaf-93de-b0493166d0cf with Priority: HIGH for action security_group_rules [ 875.253183] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0d6e05da-2389-460c-a38a-c95fe0a87162 with Priority: HIGH for action security_group_rules [ 875.253183] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 55f254c4-5a5d-440f-958c-5fd96778e473 with Priority: HIGH for action security_group_rules [ 875.253183] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 with Priority: HIGH for action security_group_rules [ 875.253183] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ca9b1416-779b-4bc5-ae29-5117ebb9bc1a with Priority: HIGH for action security_group_rules [ 875.253183] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.731550] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.731728] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.731778] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.732014] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.732190] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.732379] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.732379] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.732525] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.733503] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.733503] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.733503] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.733503] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.733503] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.733503] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.733503] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.733503] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.733969] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.733969] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.733969] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.733969] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.734130] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.761888] env[70614]: INFO networking_nsxv3.common.synchronization [req-2b3a4b1a-3710-4cf7-8778-3637cf8f3039 req-95ec90d0-fa56-4d14-9a2f-9c55b2c5ebf4 service nova] Enqueued Resource ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 with Priority: HIGHEST for action security_group_rules [ 875.761888] env[70614]: INFO networking_nsxv3.common.synchronization [req-2b3a4b1a-3710-4cf7-8778-3637cf8f3039 req-95ec90d0-fa56-4d14-9a2f-9c55b2c5ebf4 service nova] Enqueued Resource ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 with Priority: HIGHEST for action security_group_members [ 875.761888] env[70614]: INFO networking_nsxv3.common.synchronization [req-2b3a4b1a-3710-4cf7-8778-3637cf8f3039 req-95ec90d0-fa56-4d14-9a2f-9c55b2c5ebf4 service nova] Enqueued Resource ID: 6aa811e4-35d4-4df0-8891-d02b73b2c96d with Priority: HIGHEST for action port [ 875.761888] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 with Priority: HIGHEST for action security_group_rules [ 875.763529] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 with Priority: HIGHEST for action security_group_members [ 875.763591] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6aa811e4-35d4-4df0-8891-d02b73b2c96d with Priority: HIGHEST for action port [ 875.763721] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e54f39e-349d-49ad-bb07-348488d846f0 with Priority: HIGH for action security_group_rules [ 875.763844] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49dd754e-129e-49c8-9e52-09796cb64337 with Priority: HIGH for action security_group_rules [ 875.763942] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05ee2574-9125-4ff3-8197-e0eb7f0c45f2 with Priority: HIGH for action security_group_rules [ 875.764072] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8c9194b-5e05-4207-a5ab-784203682b19 with Priority: HIGH for action security_group_rules [ 875.764358] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca9b1416-779b-4bc5-ae29-5117ebb9bc1a with Priority: HIGH for action security_group_rules [ 875.764358] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 with Priority: HIGH for action security_group_rules [ 875.764358] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55f254c4-5a5d-440f-958c-5fd96778e473 with Priority: HIGH for action security_group_rules [ 875.764500] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d6e05da-2389-460c-a38a-c95fe0a87162 with Priority: HIGH for action security_group_rules [ 875.764500] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 327db6cf-92fa-437c-b166-c5060f6230e2 with Priority: HIGH for action security_group_rules [ 875.764577] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebcad34a-a932-4aaf-93de-b0493166d0cf with Priority: HIGH for action security_group_rules [ 875.764642] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b7b9850-41ce-4284-a095-b60375661eb1 with Priority: HIGH for action security_group_rules [ 875.764730] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 with Priority: HIGH for action security_group_rules [ 875.764828] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f with Priority: HIGH for action security_group_rules [ 875.764916] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64d5aaad-612c-45e4-8c2c-8d390ad3ffdd with Priority: HIGH for action security_group_rules [ 875.765014] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 428bc8ce-d8af-4c27-9ff7-291210f88a0a with Priority: HIGH for action security_group_rules [ 875.765117] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e with Priority: HIGH for action security_group_rules [ 875.765206] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a55332f-b291-4614-8b34-ee4cd0d39027 with Priority: HIGH for action security_group_rules [ 875.765304] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b with Priority: HIGH for action security_group_rules [ 875.765389] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3a4718f-fd33-4499-98fb-1aa42d62f34c with Priority: HIGH for action security_group_rules [ 875.765481] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f21a3b6e-da5e-4c92-8717-c114952a5767 with Priority: HIGH for action security_group_rules [ 875.766778] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-04a082fe-52f7-4ac6-a12b-63791c63be86 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.766778] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.766778] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.766914] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.766914] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('04a082fe-52f7-4ac6-a12b-63791c63be86',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.770919] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-04a082fe-52f7-4ac6-a12b-63791c63be86 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.771052] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.771272] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-6aa811e4-35d4-4df0-8891-d02b73b2c96d taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.771429] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6aa811e4-35d4-4df0-8891-d02b73b2c96d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.771471] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6aa811e4-35d4-4df0-8891-d02b73b2c96d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.773051] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6aa811e4-35d4-4df0-8891-d02b73b2c96d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.773051] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6aa811e4-35d4-4df0-8891-d02b73b2c96d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.773581] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e54f39e-349d-49ad-bb07-348488d846f0 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.773742] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.773742] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.773967] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.773967] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e54f39e-349d-49ad-bb07-348488d846f0',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.775943] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49dd754e-129e-49c8-9e52-09796cb64337 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.777867] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.777867] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.777867] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.777867] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49dd754e-129e-49c8-9e52-09796cb64337',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.783020] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-05ee2574-9125-4ff3-8197-e0eb7f0c45f2 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.783302] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-05ee2574-9125-4ff3-8197-e0eb7f0c45f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.783302] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-05ee2574-9125-4ff3-8197-e0eb7f0c45f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.783873] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-05ee2574-9125-4ff3-8197-e0eb7f0c45f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.783873] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('05ee2574-9125-4ff3-8197-e0eb7f0c45f2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.786551] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e8c9194b-5e05-4207-a5ab-784203682b19 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.786551] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e8c9194b-5e05-4207-a5ab-784203682b19" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.786551] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e8c9194b-5e05-4207-a5ab-784203682b19" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.786551] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e8c9194b-5e05-4207-a5ab-784203682b19" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.786551] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e8c9194b-5e05-4207-a5ab-784203682b19',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.788697] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.788859] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.788958] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.789726] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.789726] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca9b1416-779b-4bc5-ae29-5117ebb9bc1a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.790698] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-04a082fe-52f7-4ac6-a12b-63791c63be86 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.790833] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.791315] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55f254c4-5a5d-440f-958c-5fd96778e473 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.791468] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55f254c4-5a5d-440f-958c-5fd96778e473" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.791564] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55f254c4-5a5d-440f-958c-5fd96778e473" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.791804] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55f254c4-5a5d-440f-958c-5fd96778e473" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.791916] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55f254c4-5a5d-440f-958c-5fd96778e473',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.793558] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0d6e05da-2389-460c-a38a-c95fe0a87162 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.793716] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0d6e05da-2389-460c-a38a-c95fe0a87162" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.794985] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0d6e05da-2389-460c-a38a-c95fe0a87162" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.794985] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0d6e05da-2389-460c-a38a-c95fe0a87162" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.794985] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0d6e05da-2389-460c-a38a-c95fe0a87162',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.795481] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-327db6cf-92fa-437c-b166-c5060f6230e2 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.795481] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-327db6cf-92fa-437c-b166-c5060f6230e2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.795757] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-327db6cf-92fa-437c-b166-c5060f6230e2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.796025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-327db6cf-92fa-437c-b166-c5060f6230e2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.796264] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('327db6cf-92fa-437c-b166-c5060f6230e2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.801554] env[70614]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 875.801554] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ebcad34a-a932-4aaf-93de-b0493166d0cf taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.801554] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ebcad34a-a932-4aaf-93de-b0493166d0cf" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.801554] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ebcad34a-a932-4aaf-93de-b0493166d0cf" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.801554] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ebcad34a-a932-4aaf-93de-b0493166d0cf" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.801554] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ebcad34a-a932-4aaf-93de-b0493166d0cf',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.801554] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b7b9850-41ce-4284-a095-b60375661eb1 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.801999] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b7b9850-41ce-4284-a095-b60375661eb1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.801999] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b7b9850-41ce-4284-a095-b60375661eb1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.801999] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b7b9850-41ce-4284-a095-b60375661eb1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.802127] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b7b9850-41ce-4284-a095-b60375661eb1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.803307] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d3a5ad0-c473-4d61-9101-9c7582c27390 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.803444] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.803521] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.803749] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.803867] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d3a5ad0-c473-4d61-9101-9c7582c27390',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.805098] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df8f20f5-6e92-4ac4-bdd2-05863ac4905f taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.805261] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.805366] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.806015] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.806144] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df8f20f5-6e92-4ac4-bdd2-05863ac4905f',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.807171] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64d5aaad-612c-45e4-8c2c-8d390ad3ffdd taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.807273] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64d5aaad-612c-45e4-8c2c-8d390ad3ffdd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.807339] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64d5aaad-612c-45e4-8c2c-8d390ad3ffdd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.807728] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64d5aaad-612c-45e4-8c2c-8d390ad3ffdd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.807728] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64d5aaad-612c-45e4-8c2c-8d390ad3ffdd',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.808471] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-428bc8ce-d8af-4c27-9ff7-291210f88a0a taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.808579] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-428bc8ce-d8af-4c27-9ff7-291210f88a0a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.808636] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-428bc8ce-d8af-4c27-9ff7-291210f88a0a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.808788] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-428bc8ce-d8af-4c27-9ff7-291210f88a0a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.808853] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('428bc8ce-d8af-4c27-9ff7-291210f88a0a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.809730] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3060abf5-a0d6-4fce-88da-15f03f632b6e taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.809830] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.810073] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a55332f-b291-4614-8b34-ee4cd0d39027 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.810179] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.811147] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.811147] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.811147] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a55332f-b291-4614-8b34-ee4cd0d39027',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.811419] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.811553] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.811679] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c3a4718f-fd33-4499-98fb-1aa42d62f34c taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.811771] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c3a4718f-fd33-4499-98fb-1aa42d62f34c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.811840] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c3a4718f-fd33-4499-98fb-1aa42d62f34c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.812836] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c3a4718f-fd33-4499-98fb-1aa42d62f34c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.812836] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c3a4718f-fd33-4499-98fb-1aa42d62f34c',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.813063] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f21a3b6e-da5e-4c92-8717-c114952a5767 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.813063] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f21a3b6e-da5e-4c92-8717-c114952a5767" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.813063] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f21a3b6e-da5e-4c92-8717-c114952a5767" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.814413] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f21a3b6e-da5e-4c92-8717-c114952a5767" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.814413] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f21a3b6e-da5e-4c92-8717-c114952a5767',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.010453] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 in Status: SUCCESS [ 876.010751] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 deletion is rescheduled due to dependency. [ 876.010811] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.011054] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.011443] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.011540] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.011685] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.011767] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.011939] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.012035] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.012154] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04a082fe-52f7-4ac6-a12b-63791c63be86',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.012561] env[70614]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 876.237765] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b: rpc.has_security_group_logging(os_id): False [ 876.258133] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.258461] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.258535] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.258726] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.287115] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.287486] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.287683] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.287683] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.287813] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.287897] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.288094] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.288191] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.288371] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.288487] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.288584] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.289114] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.289114] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.289114] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.289665] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.289847] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.289978] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b is going to be updated. [ 876.316336] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-04a082fe-52f7-4ac6-a12b-63791c63be86 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.316608] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.316873] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-49dd754e-129e-49c8-9e52-09796cb64337 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.317009] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.317105] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.317319] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.317514] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.317621] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.317689] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.317920] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.318066] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.318344] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.318536] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('49dd754e-129e-49c8-9e52-09796cb64337',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.319806] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e54f39e-349d-49ad-bb07-348488d846f0 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.319806] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.319806] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.320133] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.320133] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.320133] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.320342] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.320342] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.320430] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.320485] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.320587] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4e54f39e-349d-49ad-bb07-348488d846f0',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.325026] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6aa811e4-35d4-4df0-8891-d02b73b2c96d with status ACTIVE [ 876.325026] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.325026] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.325026] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.325026] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.325026] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.325026] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.325026] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.325026] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.325026] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.325026] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.325026] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.325026] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.325026] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.325026] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.325026] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.325026] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6aa811e4-35d4-4df0-8891-d02b73b2c96d is going to be updated. [ 876.346414] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-55f254c4-5a5d-440f-958c-5fd96778e473 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.346580] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55f254c4-5a5d-440f-958c-5fd96778e473" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.346580] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55f254c4-5a5d-440f-958c-5fd96778e473" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.346865] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55f254c4-5a5d-440f-958c-5fd96778e473" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.346996] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.347128] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.347187] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.347329] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.347415] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.347506] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55f254c4-5a5d-440f-958c-5fd96778e473" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.347620] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('55f254c4-5a5d-440f-958c-5fd96778e473',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.359312] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.359485] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.359555] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.359754] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.359883] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.360051] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6aa811e4-35d4-4df0-8891-d02b73b2c96d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.363535] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a55332f-b291-4614-8b34-ee4cd0d39027 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.363701] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.363742] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.364552] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.364552] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.364552] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.364552] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.364552] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.364552] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.364552] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.364931] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0a55332f-b291-4614-8b34-ee4cd0d39027',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.366140] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.366140] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.366140] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.366140] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.366140] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.366140] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.366140] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.366547] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.366594] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.366685] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.366781] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ca9b1416-779b-4bc5-ae29-5117ebb9bc1a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.367751] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-64d5aaad-612c-45e4-8c2c-8d390ad3ffdd taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.367868] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64d5aaad-612c-45e4-8c2c-8d390ad3ffdd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.367931] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64d5aaad-612c-45e4-8c2c-8d390ad3ffdd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.368298] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64d5aaad-612c-45e4-8c2c-8d390ad3ffdd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.368457] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.368513] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.368552] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.368980] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.368980] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.368980] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64d5aaad-612c-45e4-8c2c-8d390ad3ffdd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.369129] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('64d5aaad-612c-45e4-8c2c-8d390ad3ffdd',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.422267] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.422541] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.422541] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.422705] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.424752] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.424859] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.425669] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.425763] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.427031] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.427149] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.428178] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.428178] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.432240] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.432240] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.432240] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.432240] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.432240] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.432240] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.432240] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.432240] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.432677] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.432677] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.432677] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.432677] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.433449] env[70614]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 876.433874] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.433991] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.474408] env[70614]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 876.475012] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.475236] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c3a4718f-fd33-4499-98fb-1aa42d62f34c is going to be deleted. [ 876.476377] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.476600] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.514580] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('04a082fe-52f7-4ac6-a12b-63791c63be86',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.528098] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.528236] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0d6e05da-2389-460c-a38a-c95fe0a87162 is going to be deleted. [ 876.529676] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.529921] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.594016] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.594195] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b7b9850-41ce-4284-a095-b60375661eb1 is going to be deleted. [ 876.595318] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.595578] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.599512] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.599765] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.635937] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.636184] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 327db6cf-92fa-437c-b166-c5060f6230e2 is going to be deleted. [ 876.637438] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.637704] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.668707] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.668884] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.707362] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.707667] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ebcad34a-a932-4aaf-93de-b0493166d0cf is going to be deleted. [ 876.710688] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.710688] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.748126] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.748472] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f21a3b6e-da5e-4c92-8717-c114952a5767 is going to be deleted. [ 876.753362] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.753760] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.756077] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.756314] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.795361] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.796937] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e8c9194b-5e05-4207-a5ab-784203682b19 is going to be deleted. [ 876.797223] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.797374] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.797561] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.974206] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.974425] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.974425] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.974608] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.974700] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.974825] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-327db6cf-92fa-437c-b166-c5060f6230e2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.975595] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.975714] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.975811] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.976141] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.976394] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.976619] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ebcad34a-a932-4aaf-93de-b0493166d0cf" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.976859] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.977073] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.978475] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-49dd754e-129e-49c8-9e52-09796cb64337 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.978689] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.978689] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.978832] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.978988] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.979132] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.979187] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.980307] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.980307] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.980307] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.980307] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-49dd754e-129e-49c8-9e52-09796cb64337 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.980307] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.980307] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.980307] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.980307] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.980307] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.980694] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.980694] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.980694] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.980807] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.980807] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('49dd754e-129e-49c8-9e52-09796cb64337',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.981738] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4e54f39e-349d-49ad-bb07-348488d846f0',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.982711] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('55f254c4-5a5d-440f-958c-5fd96778e473',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.983520] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('64d5aaad-612c-45e4-8c2c-8d390ad3ffdd',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.984425] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ca9b1416-779b-4bc5-ae29-5117ebb9bc1a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.984891] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a55332f-b291-4614-8b34-ee4cd0d39027 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.985086] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.985149] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.985366] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.985537] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.985640] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.985721] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.985872] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.985960] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.986058] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.986214] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a55332f-b291-4614-8b34-ee4cd0d39027 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.986341] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.986379] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.986511] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.986644] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.986745] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.986805] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.986942] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.987034] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.987128] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.987217] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0a55332f-b291-4614-8b34-ee4cd0d39027',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.990391] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.990507] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.017332] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('04a082fe-52f7-4ac6-a12b-63791c63be86',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.031741] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.031918] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f is going to be deleted. [ 877.033112] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.033731] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.044794] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b in Status: IN_PROGRESS for 2s [ 877.073193] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e in Status: SUCCESS [ 877.073521] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.073763] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.074068] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.074343] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.074542] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.074654] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.074904] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.075048] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.075191] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.075333] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3060abf5-a0d6-4fce-88da-15f03f632b6e',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.131068] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.131212] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 428bc8ce-d8af-4c27-9ff7-291210f88a0a is going to be deleted. [ 877.132323] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.132550] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.132662] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.132836] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c3a4718f-fd33-4499-98fb-1aa42d62f34c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.133100] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.133357] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.133479] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.133608] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0d6e05da-2389-460c-a38a-c95fe0a87162" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.134388] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.134388] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.134505] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.134719] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b7b9850-41ce-4284-a095-b60375661eb1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.134797] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.134915] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.142365] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.142365] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.201768] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.202159] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 05ee2574-9125-4ff3-8197-e0eb7f0c45f2 is going to be deleted. [ 877.203157] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.203348] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.395012] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.395012] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.396039] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.396039] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 is going to be deleted. [ 877.397181] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.397442] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.397538] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.397662] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f21a3b6e-da5e-4c92-8717-c114952a5767" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.397822] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.397973] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.398137] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.398793] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e8c9194b-5e05-4207-a5ab-784203682b19" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.399763] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.399982] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.400215] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.400448] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.449862] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.449862] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.450113] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.450385] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.450480] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.450607] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-428bc8ce-d8af-4c27-9ff7-291210f88a0a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.464608] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.464608] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.464807] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.465784] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.465784] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.465784] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-05ee2574-9125-4ff3-8197-e0eb7f0c45f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.492183] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ca9b1416-779b-4bc5-ae29-5117ebb9bc1a: rpc.has_security_group_logging(os_id): False [ 877.493559] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 64d5aaad-612c-45e4-8c2c-8d390ad3ffdd: rpc.has_security_group_logging(os_id): False [ 877.494416] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4e54f39e-349d-49ad-bb07-348488d846f0: rpc.has_security_group_logging(os_id): False [ 877.495223] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 49dd754e-129e-49c8-9e52-09796cb64337: rpc.has_security_group_logging(os_id): False [ 877.495994] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 55f254c4-5a5d-440f-958c-5fd96778e473: rpc.has_security_group_logging(os_id): False [ 877.498878] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0a55332f-b291-4614-8b34-ee4cd0d39027: rpc.has_security_group_logging(os_id): False [ 877.520159] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.520319] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.520390] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.520690] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.520793] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.520904] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 is going to be updated. [ 877.549932] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.549932] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.549932] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.549932] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.569864] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.569864] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.576377] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.576744] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.577475] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.577599] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.578050] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-3060abf5-a0d6-4fce-88da-15f03f632b6e taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.578050] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.578050] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.578639] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.578639] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.578639] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.579226] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.579226] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.579226] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.579226] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.579888] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-3060abf5-a0d6-4fce-88da-15f03f632b6e taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.579888] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.579888] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.579888] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.580426] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.580426] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.580426] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.580426] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.580426] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.580788] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.580788] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3060abf5-a0d6-4fce-88da-15f03f632b6e',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.582471] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.582607] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.583818] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.583818] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.599316] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.599316] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.619023] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.619023] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.619023] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.619023] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.619023] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.619023] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.619023] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e54f39e-349d-49ad-bb07-348488d846f0 is going to be updated. [ 877.620632] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.621123] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.634030] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.634030] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.634030] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.634030] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.634030] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.646329] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 in Status: IN_PROGRESS for 2s [ 877.668029] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.668029] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.668029] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.668029] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.668029] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.668029] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.668029] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.668029] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.668029] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.668029] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.668029] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.668029] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.668029] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.668029] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.668802] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.668802] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.668802] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a55332f-b291-4614-8b34-ee4cd0d39027 is going to be updated. [ 877.671839] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.671839] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.723676] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.724195] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.724379] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.724499] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.724783] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.724920] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.725120] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55f254c4-5a5d-440f-958c-5fd96778e473 is going to be updated. [ 877.735024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.735024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.768647] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.769255] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.769487] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.769487] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.769956] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.769956] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.769956] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64d5aaad-612c-45e4-8c2c-8d390ad3ffdd is going to be updated. [ 877.771641] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.771823] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.853861] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.854241] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.855249] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.855460] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.855644] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.855644] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.855935] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.855986] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.856244] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.856529] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.856605] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.856791] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.856898] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.857085] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.857181] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.857266] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.857391] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.857472] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.857579] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49dd754e-129e-49c8-9e52-09796cb64337 is going to be updated. [ 877.861218] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.861218] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.861218] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.861218] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.861218] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.861218] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.868146] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.868232] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.891483] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.891649] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.892617] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.892903] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.892993] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.893077] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.893281] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.893362] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.893458] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca9b1416-779b-4bc5-ae29-5117ebb9bc1a is going to be updated. [ 877.894667] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.895621] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.895621] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.896576] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.896576] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.896576] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.898048] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.898332] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.898438] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.946122] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e54f39e-349d-49ad-bb07-348488d846f0 in Status: IN_PROGRESS for 2s [ 877.946122] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55f254c4-5a5d-440f-958c-5fd96778e473 in Status: IN_PROGRESS for 2s [ 877.953368] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.953368] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.953368] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.953368] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.953368] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.959524] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a55332f-b291-4614-8b34-ee4cd0d39027 in Status: IN_PROGRESS for 2s [ 877.981891] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64d5aaad-612c-45e4-8c2c-8d390ad3ffdd in Status: IN_PROGRESS for 2s [ 878.069157] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.069787] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.069787] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.069787] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.070059] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.084761] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3060abf5-a0d6-4fce-88da-15f03f632b6e: rpc.has_security_group_logging(os_id): False [ 878.112329] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.112618] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.112796] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.113043] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.113304] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.121045] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca9b1416-779b-4bc5-ae29-5117ebb9bc1a in Status: IN_PROGRESS for 2s [ 878.127463] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.127463] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.127463] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.127463] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.142256] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49dd754e-129e-49c8-9e52-09796cb64337 in Status: IN_PROGRESS for 2s [ 878.166327] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.167079] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.167079] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.167079] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.167079] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.167365] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.167365] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.167454] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.167500] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.167649] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.167719] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.167907] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.167997] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.168067] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.168224] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.168343] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.168449] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e is going to be updated. [ 878.317801] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.317801] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.317801] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.317801] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.318391] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.335236] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e in Status: IN_PROGRESS for 2s [ 879.063283] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b in Status: SUCCESS [ 879.063283] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.063283] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.063283] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.063283] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.566520] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.566703] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.566797] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.566998] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.567295] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.567402] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.567472] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.567648] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.567737] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.567824] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.567916] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.657225] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 in Status: SUCCESS [ 879.657448] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.657621] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.657833] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.658057] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.658654] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.658654] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.658654] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.658654] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.658654] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.658654] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('04a082fe-52f7-4ac6-a12b-63791c63be86',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.966163] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55f254c4-5a5d-440f-958c-5fd96778e473 in Status: SUCCESS [ 879.966163] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55f254c4-5a5d-440f-958c-5fd96778e473" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.968157] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e54f39e-349d-49ad-bb07-348488d846f0 in Status: SUCCESS [ 879.968157] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.984332] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a55332f-b291-4614-8b34-ee4cd0d39027 in Status: SUCCESS [ 879.984635] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.998419] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64d5aaad-612c-45e4-8c2c-8d390ad3ffdd in Status: SUCCESS [ 880.002023] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64d5aaad-612c-45e4-8c2c-8d390ad3ffdd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.078034] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.078034] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.078034] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.078034] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.078034] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.078034] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.078034] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.078034] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.078034] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.078034] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.078034] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.079053] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.079053] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.079053] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.079053] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.079053] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.079053] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.080703] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.080861] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.080996] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.081149] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.138665] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca9b1416-779b-4bc5-ae29-5117ebb9bc1a in Status: SUCCESS [ 880.139268] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.162156] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49dd754e-129e-49c8-9e52-09796cb64337 in Status: SUCCESS [ 880.163157] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.164528] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-04a082fe-52f7-4ac6-a12b-63791c63be86 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.164528] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.164528] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.164528] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.164528] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.164528] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.164528] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.164528] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.165248] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.165248] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.165248] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-04a082fe-52f7-4ac6-a12b-63791c63be86 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.165248] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.165248] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.165248] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.165556] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.165556] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.165556] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.165686] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.165760] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.165839] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.165923] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('04a082fe-52f7-4ac6-a12b-63791c63be86',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.352559] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e in Status: SUCCESS [ 880.352838] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.354038] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.354038] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.354038] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3060abf5-a0d6-4fce-88da-15f03f632b6e',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.585210] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b: rpc.has_security_group_logging(os_id): False [ 880.608163] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.608334] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.608416] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.608643] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.608739] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.608987] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.609242] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.609540] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.609540] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.609634] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.609911] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.612023] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.612023] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.612023] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.612023] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.612023] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.612023] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.612023] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.612023] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.612023] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.612023] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b is going to be updated. [ 880.669128] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 04a082fe-52f7-4ac6-a12b-63791c63be86: rpc.has_security_group_logging(os_id): False [ 880.704029] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.704029] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.704029] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.704029] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.717758] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.718033] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.727600] env[70614]: INFO networking_nsxv3.common.synchronization [None req-bbc7e450-43db-410f-a755-1dbc393a1b2c None None] Enqueued Resource ID: ac5c84e9-5fe5-4735-a3c6-5676e898d486 with Priority: HIGHEST for action port [ 880.728030] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac5c84e9-5fe5-4735-a3c6-5676e898d486 with Priority: HIGHEST for action port [ 880.729765] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-ac5c84e9-5fe5-4735-a3c6-5676e898d486 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.729765] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ac5c84e9-5fe5-4735-a3c6-5676e898d486" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.729765] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ac5c84e9-5fe5-4735-a3c6-5676e898d486" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.729765] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ac5c84e9-5fe5-4735-a3c6-5676e898d486" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.732443] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac5c84e9-5fe5-4735-a3c6-5676e898d486',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.737136] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.737522] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.737672] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.737672] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.737910] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.738261] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.738506] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.738662] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.738739] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.739100] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.739100] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.739364] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.739498] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.739574] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.740253] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.740369] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.740460] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 is going to be updated. [ 880.742418] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.742565] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.742734] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.761866] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b in Status: IN_PROGRESS for 2s [ 880.830363] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.830363] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.830363] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.830363] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.830570] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.849672] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 in Status: IN_PROGRESS for 2s [ 880.857679] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-3060abf5-a0d6-4fce-88da-15f03f632b6e taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.857679] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.857679] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.857679] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.857679] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.857679] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.857679] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.857679] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.857679] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.857679] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.857679] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3060abf5-a0d6-4fce-88da-15f03f632b6e',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.245885] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ac5c84e9-5fe5-4735-a3c6-5676e898d486 [ 881.245885] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.246385] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.246385] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.246385] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.246501] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.246644] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ac5c84e9-5fe5-4735-a3c6-5676e898d486 already deleted. [ 881.246753] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ac5c84e9-5fe5-4735-a3c6-5676e898d486" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.359769] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-3060abf5-a0d6-4fce-88da-15f03f632b6e taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.361908] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.362064] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.362286] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.362482] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.362601] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.362690] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.362820] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.362898] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.362998] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.363177] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-3060abf5-a0d6-4fce-88da-15f03f632b6e taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.363278] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.363349] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.363471] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.363732] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.363732] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.363732] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.363886] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.364038] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.364038] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.364746] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3060abf5-a0d6-4fce-88da-15f03f632b6e',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.866941] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3060abf5-a0d6-4fce-88da-15f03f632b6e: rpc.has_security_group_logging(os_id): False [ 881.892804] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.892804] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.892804] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.892804] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.892804] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.897835] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.897835] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.897835] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.897979] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.898312] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.898312] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.898512] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.898512] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.902026] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.902026] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.902026] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.902026] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.902026] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.902026] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.902026] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.902026] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e is going to be updated. [ 882.015147] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.015299] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.015342] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.015542] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.015739] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.033240] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e in Status: IN_PROGRESS for 2s [ 882.213336] env[70614]: INFO networking_nsxv3.common.synchronization [req-377ba24d-8f27-4034-9d50-a64d47431923 req-d1631339-c4fc-43d3-9e90-31a78d92ccb1 tempest-ServersV294TestFqdnHostnames-346829035 tempest-ServersV294TestFqdnHostnames-346829035-project-member] Enqueued Resource ID: 3f4770f9-9c1b-48b7-8d14-3089a02098e4 with Priority: HIGHEST for action security_group_members [ 882.214740] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f4770f9-9c1b-48b7-8d14-3089a02098e4 with Priority: HIGHEST for action security_group_members [ 882.215243] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f4770f9-9c1b-48b7-8d14-3089a02098e4 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.215483] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f4770f9-9c1b-48b7-8d14-3089a02098e4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.215596] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f4770f9-9c1b-48b7-8d14-3089a02098e4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.216581] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f4770f9-9c1b-48b7-8d14-3089a02098e4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.216774] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.216948] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.217475] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.217475] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.217632] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.217697] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f4770f9-9c1b-48b7-8d14-3089a02098e4',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.726071] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.726071] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.726521] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.726521] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.726521] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.726644] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.726747] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.726812] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.727022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.727087] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.727173] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f4770f9-9c1b-48b7-8d14-3089a02098e4 already deleted. [ 882.727256] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f4770f9-9c1b-48b7-8d14-3089a02098e4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.778551] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-663 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.778807] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-663" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.778938] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-663" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.779327] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-663" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.780992] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.780992] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.780992] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.780992] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.780992] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.781289] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 882.781289] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 882.781402] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 882.781527] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 882.781644] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 882.781751] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 882.781886] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 882.783658] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b in Status: SUCCESS [ 882.783852] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.806719] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 882.806935] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 882.807087] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 882.808943] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-663" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.808943] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-6711a868-c646-44c5-ba08-d7aceff0c4b8 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.808943] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-6711a868-c646-44c5-ba08-d7aceff0c4b8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.808943] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-6711a868-c646-44c5-ba08-d7aceff0c4b8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.808943] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-6711a868-c646-44c5-ba08-d7aceff0c4b8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.808943] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6711a868-c646-44c5-ba08-d7aceff0c4b8',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.877461] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 in Status: SUCCESS [ 882.877461] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.877461] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.877461] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.877461] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('04a082fe-52f7-4ac6-a12b-63791c63be86',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.316890] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.317204] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.317328] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.317514] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.317662] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.317819] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 6711a868-c646-44c5-ba08-d7aceff0c4b8 not found, creating... [ 883.318099] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.318261] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.318420] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.318658] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.318838] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.319128] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.319288] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.319442] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.319681] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.322019] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.322199] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 6711a868-c646-44c5-ba08-d7aceff0c4b8 is going to be created. [ 883.344715] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.344984] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.345133] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.345459] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.345725] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.346027] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-6711a868-c646-44c5-ba08-d7aceff0c4b8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.379528] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-04a082fe-52f7-4ac6-a12b-63791c63be86 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.379763] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.379874] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.380256] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.380442] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.380592] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.380696] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.380897] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.381037] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.381172] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.381304] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('04a082fe-52f7-4ac6-a12b-63791c63be86',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.409222] env[70614]: INFO networking_nsxv3.common.synchronization [None req-0e6cd5b2-c193-4541-899e-9fb95a8d61f8 None None] Enqueued Resource ID: 76930ba2-02ea-41ba-a805-21a301d8e650 with Priority: HIGHEST for action port [ 883.409222] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76930ba2-02ea-41ba-a805-21a301d8e650 with Priority: HIGHEST for action port [ 883.410211] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-76930ba2-02ea-41ba-a805-21a301d8e650 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.410528] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-76930ba2-02ea-41ba-a805-21a301d8e650" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.410726] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-76930ba2-02ea-41ba-a805-21a301d8e650" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.411168] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-76930ba2-02ea-41ba-a805-21a301d8e650" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.411381] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('76930ba2-02ea-41ba-a805-21a301d8e650',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.887644] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-04a082fe-52f7-4ac6-a12b-63791c63be86 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.888040] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.888040] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.888141] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.888264] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.888398] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.888458] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.888613] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.888707] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.888990] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.888990] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-04a082fe-52f7-4ac6-a12b-63791c63be86 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.889149] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.889149] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.889245] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.889354] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.889448] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.889504] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.889627] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.889699] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.889779] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.889871] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('04a082fe-52f7-4ac6-a12b-63791c63be86',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.913074] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 76930ba2-02ea-41ba-a805-21a301d8e650 [ 883.913309] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.913438] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.913506] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.913708] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.913794] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.913954] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:76930ba2-02ea-41ba-a805-21a301d8e650 already deleted. [ 883.913954] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-76930ba2-02ea-41ba-a805-21a301d8e650" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.047754] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e in Status: SUCCESS [ 884.047992] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.298859] env[70614]: INFO networking_nsxv3.common.synchronization [req-377ba24d-8f27-4034-9d50-a64d47431923 req-d2a9cdb6-7aa5-4ee1-87ea-2a30bbb35bd1 service nova] Enqueued Resource ID: 3f4770f9-9c1b-48b7-8d14-3089a02098e4 with Priority: HIGHEST for action security_group_rules [ 884.299331] env[70614]: INFO networking_nsxv3.common.synchronization [req-377ba24d-8f27-4034-9d50-a64d47431923 req-d2a9cdb6-7aa5-4ee1-87ea-2a30bbb35bd1 service nova] Enqueued Resource ID: 3f4770f9-9c1b-48b7-8d14-3089a02098e4 with Priority: HIGHEST for action security_group_members [ 884.299437] env[70614]: INFO networking_nsxv3.common.synchronization [req-377ba24d-8f27-4034-9d50-a64d47431923 req-d2a9cdb6-7aa5-4ee1-87ea-2a30bbb35bd1 service nova] Enqueued Resource ID: 6711a868-c646-44c5-ba08-d7aceff0c4b8 with Priority: HIGHEST for action port [ 884.301217] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f4770f9-9c1b-48b7-8d14-3089a02098e4 with Priority: HIGHEST for action security_group_rules [ 884.301409] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f4770f9-9c1b-48b7-8d14-3089a02098e4 with Priority: HIGHEST for action security_group_members [ 884.301485] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6711a868-c646-44c5-ba08-d7aceff0c4b8 with Priority: HIGHEST for action port [ 884.302562] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3f4770f9-9c1b-48b7-8d14-3089a02098e4 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.302562] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3f4770f9-9c1b-48b7-8d14-3089a02098e4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.302562] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3f4770f9-9c1b-48b7-8d14-3089a02098e4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.302894] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3f4770f9-9c1b-48b7-8d14-3089a02098e4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.302894] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3f4770f9-9c1b-48b7-8d14-3089a02098e4',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.303831] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f4770f9-9c1b-48b7-8d14-3089a02098e4 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.303831] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f4770f9-9c1b-48b7-8d14-3089a02098e4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.303831] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f4770f9-9c1b-48b7-8d14-3089a02098e4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.304101] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f4770f9-9c1b-48b7-8d14-3089a02098e4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.304198] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.304321] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.304383] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.304597] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.304597] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.304699] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f4770f9-9c1b-48b7-8d14-3089a02098e4',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.305483] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-6711a868-c646-44c5-ba08-d7aceff0c4b8 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.305607] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6711a868-c646-44c5-ba08-d7aceff0c4b8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.305668] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6711a868-c646-44c5-ba08-d7aceff0c4b8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.305820] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6711a868-c646-44c5-ba08-d7aceff0c4b8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.306170] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6711a868-c646-44c5-ba08-d7aceff0c4b8',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.395620] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 04a082fe-52f7-4ac6-a12b-63791c63be86: rpc.has_security_group_logging(os_id): False [ 884.415368] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.415604] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.415669] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.415940] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.416075] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.416385] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.416523] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.416608] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.416823] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.416930] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.417211] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.417343] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.432566] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.432566] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.432566] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.432566] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.432566] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.432566] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.432566] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.432566] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.432566] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 is going to be updated. [ 884.498449] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.499876] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.499876] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.499876] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.499876] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.515984] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 in Status: IN_PROGRESS for 2s [ 884.748014] env[70614]: INFO networking_nsxv3.common.synchronization [req-91a337de-c205-4d2a-a3e8-a01507d554a4 req-a30982c3-7ae8-4681-a0f5-a9e6e03ae55c tempest-DeleteServersTestJSON-1690139659 tempest-DeleteServersTestJSON-1690139659-project-member] Enqueued Resource ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f with Priority: HIGHEST for action security_group_members [ 884.748691] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f with Priority: HIGHEST for action security_group_members [ 884.752254] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.752496] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.752597] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.752841] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.753598] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.753718] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.753786] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.753960] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.754052] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.754197] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df8f20f5-6e92-4ac4-bdd2-05863ac4905f',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.807886] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f4770f9-9c1b-48b7-8d14-3089a02098e4 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.808049] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f4770f9-9c1b-48b7-8d14-3089a02098e4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.808185] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3f4770f9-9c1b-48b7-8d14-3089a02098e4',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.810748] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6711a868-c646-44c5-ba08-d7aceff0c4b8 with status ACTIVE [ 884.811067] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.811173] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.811173] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.811338] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.811425] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.811689] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.811689] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.811874] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.811874] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.811976] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.812129] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.812232] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.812299] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.812406] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.812478] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.812588] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6711a868-c646-44c5-ba08-d7aceff0c4b8 is going to be updated. [ 884.833307] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.833453] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.833618] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.833734] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.833870] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.834042] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6711a868-c646-44c5-ba08-d7aceff0c4b8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.159329] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-707 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.159698] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-707" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.159698] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-707" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.159982] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-707" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.160275] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.160465] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.160927] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.160927] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.161281] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.161281] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 885.161396] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 885.161463] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 885.161567] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 885.161690] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 885.161798] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 885.161935] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 885.181948] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 885.182181] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 885.182289] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 885.182462] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-707" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.182778] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-b0205051-4c57-4c93-9af0-9d485ff54959 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.182954] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-b0205051-4c57-4c93-9af0-9d485ff54959" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.183093] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-b0205051-4c57-4c93-9af0-9d485ff54959" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.183435] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-b0205051-4c57-4c93-9af0-9d485ff54959" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.183584] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0205051-4c57-4c93-9af0-9d485ff54959',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.256537] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.256754] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.256754] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.257057] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.257057] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.257267] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.257364] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.257424] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.257561] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.257633] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.257719] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f is going to be deleted. [ 885.290670] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.290928] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.290928] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.291163] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.291216] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.291307] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.310438] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3f4770f9-9c1b-48b7-8d14-3089a02098e4',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.686729] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.687068] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.687164] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.687461] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.687691] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.687956] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port b0205051-4c57-4c93-9af0-9d485ff54959 not found, creating... [ 885.688385] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.688602] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.688746] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.689043] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.689254] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.689713] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.689937] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.690112] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.690349] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.690538] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.690676] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: b0205051-4c57-4c93-9af0-9d485ff54959 is going to be created. [ 885.714255] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.714459] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.714609] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.715129] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.715308] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.715640] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-b0205051-4c57-4c93-9af0-9d485ff54959" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.814034] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.814265] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.814347] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.814860] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.814989] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.815127] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f4770f9-9c1b-48b7-8d14-3089a02098e4 is going to be created. [ 885.849867] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.850127] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.850180] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.850981] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.850981] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.864038] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f4770f9-9c1b-48b7-8d14-3089a02098e4 in Status: UNINITIALIZED for 2s [ 886.532141] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 in Status: SUCCESS [ 886.532141] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.590612] env[70614]: INFO networking_nsxv3.common.synchronization [req-91a337de-c205-4d2a-a3e8-a01507d554a4 req-51ddd19d-6cb2-432e-9adc-9175537355bd service nova] Enqueued Resource ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f with Priority: HIGHEST for action security_group_rules [ 886.590913] env[70614]: INFO networking_nsxv3.common.synchronization [req-91a337de-c205-4d2a-a3e8-a01507d554a4 req-51ddd19d-6cb2-432e-9adc-9175537355bd service nova] Enqueued Resource ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f with Priority: HIGHEST for action security_group_members [ 886.591081] env[70614]: INFO networking_nsxv3.common.synchronization [req-91a337de-c205-4d2a-a3e8-a01507d554a4 req-51ddd19d-6cb2-432e-9adc-9175537355bd service nova] Enqueued Resource ID: b0205051-4c57-4c93-9af0-9d485ff54959 with Priority: HIGHEST for action port [ 886.591683] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f with Priority: HIGHEST for action security_group_rules [ 886.591847] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f with Priority: HIGHEST for action security_group_members [ 886.591972] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0205051-4c57-4c93-9af0-9d485ff54959 with Priority: HIGHEST for action port [ 886.592431] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df8f20f5-6e92-4ac4-bdd2-05863ac4905f taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.592630] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.592706] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.592994] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.593095] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df8f20f5-6e92-4ac4-bdd2-05863ac4905f',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.594726] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.594726] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.594927] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.595065] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.595305] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.595470] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.595470] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.595759] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.595848] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.595930] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df8f20f5-6e92-4ac4-bdd2-05863ac4905f',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.596908] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-b0205051-4c57-4c93-9af0-9d485ff54959 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.597073] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b0205051-4c57-4c93-9af0-9d485ff54959" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.597073] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b0205051-4c57-4c93-9af0-9d485ff54959" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.597229] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b0205051-4c57-4c93-9af0-9d485ff54959" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.597318] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0205051-4c57-4c93-9af0-9d485ff54959',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.099017] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.099168] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.099376] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('df8f20f5-6e92-4ac4-bdd2-05863ac4905f',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.100366] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b0205051-4c57-4c93-9af0-9d485ff54959 with status ACTIVE [ 887.100560] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.100681] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.100749] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.100957] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.101063] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.101255] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.101340] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.101383] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.101526] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.101803] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.102427] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.102615] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.102707] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.103158] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.103286] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.103405] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b0205051-4c57-4c93-9af0-9d485ff54959 is going to be updated. [ 887.130771] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.132565] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.132695] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.132943] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.133101] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.134463] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b0205051-4c57-4c93-9af0-9d485ff54959" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.375559] env[70614]: INFO networking_nsxv3.common.synchronization [req-79a3eca0-d548-4619-bf1b-9f499b1c6e26 req-96b8dfb6-d58c-4f72-ab79-9dc70cc65020 tempest-ServersTestManualDisk-62724510 tempest-ServersTestManualDisk-62724510-project-member] Enqueued Resource ID: 336e562f-9c8e-4021-953e-5756518b10b0 with Priority: HIGHEST for action security_group_members [ 887.380022] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 336e562f-9c8e-4021-953e-5756518b10b0 with Priority: HIGHEST for action security_group_members [ 887.380022] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-336e562f-9c8e-4021-953e-5756518b10b0 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.380022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-336e562f-9c8e-4021-953e-5756518b10b0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.380022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-336e562f-9c8e-4021-953e-5756518b10b0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.380022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-336e562f-9c8e-4021-953e-5756518b10b0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.380022] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.380022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.380022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.380022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.380022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.380022] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('336e562f-9c8e-4021-953e-5756518b10b0',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.606579] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('df8f20f5-6e92-4ac4-bdd2-05863ac4905f',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.875038] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f4770f9-9c1b-48b7-8d14-3089a02098e4 in Status: SUCCESS [ 887.875038] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f4770f9-9c1b-48b7-8d14-3089a02098e4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.875273] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f4770f9-9c1b-48b7-8d14-3089a02098e4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.875384] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f4770f9-9c1b-48b7-8d14-3089a02098e4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.875606] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.875729] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.875802] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.876028] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.876081] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.876742] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f4770f9-9c1b-48b7-8d14-3089a02098e4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.876742] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3f4770f9-9c1b-48b7-8d14-3089a02098e4',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.882880] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.882880] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.882880] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.882880] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.914720] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.914980] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.915280] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.915280] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.915414] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.915681] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.915943] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 336e562f-9c8e-4021-953e-5756518b10b0 is going to be updated. [ 887.942024] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.942024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.942024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.942281] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.942379] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.952178] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 336e562f-9c8e-4021-953e-5756518b10b0 in Status: IN_PROGRESS for 2s [ 888.109409] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.109611] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.109663] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.109841] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.109928] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.110039] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f is going to be created. [ 888.134310] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.134310] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.134310] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.134310] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.134310] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.145780] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f in Status: UNINITIALIZED for 2s [ 888.378901] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3f4770f9-9c1b-48b7-8d14-3089a02098e4',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.881680] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3f4770f9-9c1b-48b7-8d14-3089a02098e4: rpc.has_security_group_logging(os_id): False [ 888.902333] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.902485] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.902559] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.902842] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.902885] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.903121] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.903228] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.903279] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.903668] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.903668] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.903668] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3f4770f9-9c1b-48b7-8d14-3089a02098e4 is going to be created. [ 889.000476] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.000870] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.000870] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.001110] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.001318] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.014918] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3f4770f9-9c1b-48b7-8d14-3089a02098e4 in Status: IN_PROGRESS for 2s [ 889.373793] env[70614]: INFO networking_nsxv3.common.synchronization [req-bdb5b12f-2412-41ec-951e-b7445c5199b9 req-10af5ec5-d17f-4cf2-8d35-0329ef623330 tempest-ServerActionsTestOtherA-302418031 tempest-ServerActionsTestOtherA-302418031-project-member] Enqueued Resource ID: f58ad372-72ca-472a-aab5-8b86e9d2f1e6 with Priority: HIGHEST for action security_group_members [ 889.374562] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f58ad372-72ca-472a-aab5-8b86e9d2f1e6 with Priority: HIGHEST for action security_group_members [ 889.374803] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-f58ad372-72ca-472a-aab5-8b86e9d2f1e6 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.374935] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f58ad372-72ca-472a-aab5-8b86e9d2f1e6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.375053] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f58ad372-72ca-472a-aab5-8b86e9d2f1e6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.375329] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f58ad372-72ca-472a-aab5-8b86e9d2f1e6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.375494] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.375599] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.375692] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.375804] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.375888] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.375982] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f58ad372-72ca-472a-aab5-8b86e9d2f1e6',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.810484] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-367 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.810745] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-367" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.810892] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-367" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.811231] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-367" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.811496] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.811762] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.811844] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.811997] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.812157] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.812371] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 889.812489] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 889.812631] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 889.812748] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 889.812861] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 889.812968] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 889.813115] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 889.831138] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 889.831329] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 889.831424] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 889.831609] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-367" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.831933] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-c5ea49cd-eafc-4ac3-9bd5-8e76413ef857 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.832173] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-c5ea49cd-eafc-4ac3-9bd5-8e76413ef857" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.832321] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-c5ea49cd-eafc-4ac3-9bd5-8e76413ef857" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.832637] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-c5ea49cd-eafc-4ac3-9bd5-8e76413ef857" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.832782] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5ea49cd-eafc-4ac3-9bd5-8e76413ef857',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.878226] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.878431] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.878513] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.878745] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.878872] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.879031] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.879194] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.879238] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.879365] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.879444] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.879527] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f58ad372-72ca-472a-aab5-8b86e9d2f1e6 already deleted. [ 889.879596] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f58ad372-72ca-472a-aab5-8b86e9d2f1e6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.964202] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 336e562f-9c8e-4021-953e-5756518b10b0 in Status: SUCCESS [ 889.964202] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 336e562f-9c8e-4021-953e-5756518b10b0 deletion is rescheduled due to dependency. [ 889.964660] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-336e562f-9c8e-4021-953e-5756518b10b0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.160784] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f in Status: SUCCESS [ 890.161018] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.161084] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.161296] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.161510] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.161635] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.161703] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.161873] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.161955] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.162082] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.162288] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('df8f20f5-6e92-4ac4-bdd2-05863ac4905f',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.335377] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.336670] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.336917] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.337270] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.337462] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.337669] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port c5ea49cd-eafc-4ac3-9bd5-8e76413ef857 not found, creating... [ 890.338018] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.338257] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.338467] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.338732] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.338922] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.339533] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.339533] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.339695] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.339909] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.340116] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.340289] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: c5ea49cd-eafc-4ac3-9bd5-8e76413ef857 is going to be created. [ 890.364345] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.364649] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.364835] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.365165] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.365503] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.366011] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-c5ea49cd-eafc-4ac3-9bd5-8e76413ef857" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.665600] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.665965] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.665965] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.666306] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.666474] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.666610] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.666789] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.666944] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.667040] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.667161] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.672333] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.672333] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.672333] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.672333] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.672333] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.672333] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.672333] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.673160] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.673160] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.673160] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.673160] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('df8f20f5-6e92-4ac4-bdd2-05863ac4905f',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.028150] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3f4770f9-9c1b-48b7-8d14-3089a02098e4 in Status: SUCCESS [ 891.028617] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3f4770f9-9c1b-48b7-8d14-3089a02098e4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.112852] env[70614]: INFO networking_nsxv3.common.synchronization [req-bdb5b12f-2412-41ec-951e-b7445c5199b9 req-2c6d8569-c0e4-44c0-a21f-844e1780573d service nova] Enqueued Resource ID: f58ad372-72ca-472a-aab5-8b86e9d2f1e6 with Priority: HIGHEST for action security_group_rules [ 891.113016] env[70614]: INFO networking_nsxv3.common.synchronization [req-bdb5b12f-2412-41ec-951e-b7445c5199b9 req-2c6d8569-c0e4-44c0-a21f-844e1780573d service nova] Enqueued Resource ID: f58ad372-72ca-472a-aab5-8b86e9d2f1e6 with Priority: HIGHEST for action security_group_members [ 891.113189] env[70614]: INFO networking_nsxv3.common.synchronization [req-bdb5b12f-2412-41ec-951e-b7445c5199b9 req-2c6d8569-c0e4-44c0-a21f-844e1780573d service nova] Enqueued Resource ID: c5ea49cd-eafc-4ac3-9bd5-8e76413ef857 with Priority: HIGHEST for action port [ 891.113777] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f58ad372-72ca-472a-aab5-8b86e9d2f1e6 with Priority: HIGHEST for action security_group_rules [ 891.113911] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f58ad372-72ca-472a-aab5-8b86e9d2f1e6 with Priority: HIGHEST for action security_group_members [ 891.114014] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5ea49cd-eafc-4ac3-9bd5-8e76413ef857 with Priority: HIGHEST for action port [ 891.114424] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f58ad372-72ca-472a-aab5-8b86e9d2f1e6 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.114591] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f58ad372-72ca-472a-aab5-8b86e9d2f1e6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.114704] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f58ad372-72ca-472a-aab5-8b86e9d2f1e6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.114923] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f58ad372-72ca-472a-aab5-8b86e9d2f1e6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.115065] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f58ad372-72ca-472a-aab5-8b86e9d2f1e6',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.116123] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-f58ad372-72ca-472a-aab5-8b86e9d2f1e6 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.116224] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f58ad372-72ca-472a-aab5-8b86e9d2f1e6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.116268] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f58ad372-72ca-472a-aab5-8b86e9d2f1e6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.116539] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f58ad372-72ca-472a-aab5-8b86e9d2f1e6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.118585] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.118585] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.118585] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.118585] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.118585] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.118585] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f58ad372-72ca-472a-aab5-8b86e9d2f1e6',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.118585] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-c5ea49cd-eafc-4ac3-9bd5-8e76413ef857 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.118585] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c5ea49cd-eafc-4ac3-9bd5-8e76413ef857" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.118585] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c5ea49cd-eafc-4ac3-9bd5-8e76413ef857" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.119151] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c5ea49cd-eafc-4ac3-9bd5-8e76413ef857" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.119151] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5ea49cd-eafc-4ac3-9bd5-8e76413ef857',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.175460] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for df8f20f5-6e92-4ac4-bdd2-05863ac4905f: rpc.has_security_group_logging(os_id): False [ 891.199396] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.199559] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.199676] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.199949] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.200102] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.200505] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.200749] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.200884] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.202047] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.202047] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.202295] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.202295] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.202566] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.202566] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.202566] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.202750] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.202857] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.202925] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.203085] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.203197] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.203285] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f is going to be created. [ 891.269058] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.270153] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.270153] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.270153] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.270153] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.284939] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f in Status: IN_PROGRESS for 2s [ 891.621155] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-f58ad372-72ca-472a-aab5-8b86e9d2f1e6 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.621328] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f58ad372-72ca-472a-aab5-8b86e9d2f1e6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.622598] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f58ad372-72ca-472a-aab5-8b86e9d2f1e6',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.622598] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c5ea49cd-eafc-4ac3-9bd5-8e76413ef857 with status ACTIVE [ 891.622598] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.623061] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.623061] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.623061] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.623061] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.623214] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.623311] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.623373] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.623517] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.623592] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.623770] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.623854] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.623915] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.624076] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.624151] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.624250] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c5ea49cd-eafc-4ac3-9bd5-8e76413ef857 is going to be updated. [ 891.649250] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.649432] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.649550] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.649694] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.649827] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.649986] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c5ea49cd-eafc-4ac3-9bd5-8e76413ef857" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.126740] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f58ad372-72ca-472a-aab5-8b86e9d2f1e6',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.461699] env[70614]: INFO networking_nsxv3.common.synchronization [req-88012b28-a7ad-4290-8f4e-17ed906abf51 req-1943ef38-5d57-4ff2-bdcb-f0da8495ad8b tempest-SecurityGroupsTestJSON-818479832 tempest-SecurityGroupsTestJSON-818479832-project-member] Enqueued Resource ID: 81470f34-f44d-4111-b9a8-fc43c119e1dd with Priority: HIGHEST for action security_group_members [ 892.461945] env[70614]: INFO networking_nsxv3.common.synchronization [req-88012b28-a7ad-4290-8f4e-17ed906abf51 req-1943ef38-5d57-4ff2-bdcb-f0da8495ad8b tempest-SecurityGroupsTestJSON-818479832 tempest-SecurityGroupsTestJSON-818479832-project-member] Enqueued Resource ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 with Priority: HIGHEST for action security_group_members [ 892.462041] env[70614]: INFO networking_nsxv3.common.synchronization [req-88012b28-a7ad-4290-8f4e-17ed906abf51 req-1943ef38-5d57-4ff2-bdcb-f0da8495ad8b tempest-SecurityGroupsTestJSON-818479832 tempest-SecurityGroupsTestJSON-818479832-project-member] Enqueued Resource ID: 55f254c4-5a5d-440f-958c-5fd96778e473 with Priority: HIGHEST for action security_group_members [ 892.462611] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81470f34-f44d-4111-b9a8-fc43c119e1dd with Priority: HIGHEST for action security_group_members [ 892.462758] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 with Priority: HIGHEST for action security_group_members [ 892.462916] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55f254c4-5a5d-440f-958c-5fd96778e473 with Priority: HIGHEST for action security_group_members [ 892.463811] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-81470f34-f44d-4111-b9a8-fc43c119e1dd taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.463955] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81470f34-f44d-4111-b9a8-fc43c119e1dd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.464036] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81470f34-f44d-4111-b9a8-fc43c119e1dd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.464448] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81470f34-f44d-4111-b9a8-fc43c119e1dd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.464448] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.464614] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.464614] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.464901] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.464901] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.464901] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('81470f34-f44d-4111-b9a8-fc43c119e1dd',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.467092] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.467227] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.467314] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.467535] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.468058] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.468058] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.468058] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.468360] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.468360] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.468360] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1440acfc-c5d6-4a44-b0a8-654c4f16a7d1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.470072] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-55f254c4-5a5d-440f-958c-5fd96778e473 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.470257] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55f254c4-5a5d-440f-958c-5fd96778e473" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.470378] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55f254c4-5a5d-440f-958c-5fd96778e473" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.470989] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55f254c4-5a5d-440f-958c-5fd96778e473" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.471081] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.471251] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.471362] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.471648] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.471820] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.471986] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55f254c4-5a5d-440f-958c-5fd96778e473',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.629517] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.629774] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.629774] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.629948] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.630060] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.630641] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f58ad372-72ca-472a-aab5-8b86e9d2f1e6 is going to be created. [ 892.657747] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.657953] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.658131] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.658433] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.658652] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.671183] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f58ad372-72ca-472a-aab5-8b86e9d2f1e6 in Status: UNINITIALIZED for 2s [ 892.967562] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.967748] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.967830] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.968075] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.970947] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.971117] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.974645] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.974763] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.993995] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.994294] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.994416] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.994502] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.994730] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.994805] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.994874] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81470f34-f44d-4111-b9a8-fc43c119e1dd is going to be updated. [ 892.995860] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.000210] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.028239] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.028239] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.028239] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.028239] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.028239] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.028239] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.028239] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 is going to be updated. [ 893.028239] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.028239] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.028239] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.029036] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.029163] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.029230] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.029394] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.029485] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.029612] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55f254c4-5a5d-440f-958c-5fd96778e473 is going to be updated. [ 893.034202] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.034359] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.034403] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.035366] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.035366] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.047125] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81470f34-f44d-4111-b9a8-fc43c119e1dd in Status: IN_PROGRESS for 2s [ 893.066227] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.066539] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.066616] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.066837] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.066973] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.069513] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.069647] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.069734] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.069959] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.070147] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.083624] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 in Status: IN_PROGRESS for 2s [ 893.087278] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55f254c4-5a5d-440f-958c-5fd96778e473 in Status: IN_PROGRESS for 2s [ 893.311986] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f in Status: SUCCESS [ 893.312885] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.689231] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f58ad372-72ca-472a-aab5-8b86e9d2f1e6 in Status: SUCCESS [ 894.689231] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f58ad372-72ca-472a-aab5-8b86e9d2f1e6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.689231] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f58ad372-72ca-472a-aab5-8b86e9d2f1e6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.689231] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f58ad372-72ca-472a-aab5-8b86e9d2f1e6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.689231] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.689801] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.689801] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.689801] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.689801] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.689801] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f58ad372-72ca-472a-aab5-8b86e9d2f1e6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.689801] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f58ad372-72ca-472a-aab5-8b86e9d2f1e6',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.068658] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81470f34-f44d-4111-b9a8-fc43c119e1dd in Status: SUCCESS [ 895.068765] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81470f34-f44d-4111-b9a8-fc43c119e1dd deletion is rescheduled due to dependency. [ 895.068996] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81470f34-f44d-4111-b9a8-fc43c119e1dd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.094545] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 in Status: SUCCESS [ 895.094656] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 deletion is rescheduled due to dependency. [ 895.094768] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.097295] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55f254c4-5a5d-440f-958c-5fd96778e473 in Status: SUCCESS [ 895.097295] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55f254c4-5a5d-440f-958c-5fd96778e473 deletion is rescheduled due to dependency. [ 895.097295] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55f254c4-5a5d-440f-958c-5fd96778e473" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.192651] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f58ad372-72ca-472a-aab5-8b86e9d2f1e6',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.696532] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f58ad372-72ca-472a-aab5-8b86e9d2f1e6: rpc.has_security_group_logging(os_id): False [ 895.719046] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.720130] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.720130] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.720130] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.720130] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.721144] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.721144] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.721144] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.721144] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.721144] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.721144] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f58ad372-72ca-472a-aab5-8b86e9d2f1e6 is going to be created. [ 895.788584] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.788797] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.788986] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.789092] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.793025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.806340] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f58ad372-72ca-472a-aab5-8b86e9d2f1e6 in Status: IN_PROGRESS for 2s [ 897.464241] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 897.464241] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 897.469089] env[70614]: INFO networking_nsxv3.common.synchronization [req-abe4568e-ddf8-4aea-a348-fa7ffbc407d4 req-8ac7d839-88b7-49cc-a073-d6fbd1f897f6 tempest-ImagesOneServerNegativeTestJSON-1769697081 tempest-ImagesOneServerNegativeTestJSON-1769697081-project-member] Enqueued Resource ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e with Priority: HIGHEST for action security_group_members [ 897.470091] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e with Priority: HIGHEST for action security_group_members [ 897.470960] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-3060abf5-a0d6-4fce-88da-15f03f632b6e taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.472112] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.472112] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.472112] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.473653] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.473653] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.473653] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.474012] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.474387] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.474711] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3060abf5-a0d6-4fce-88da-15f03f632b6e',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.821319] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f58ad372-72ca-472a-aab5-8b86e9d2f1e6 in Status: SUCCESS [ 897.821319] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f58ad372-72ca-472a-aab5-8b86e9d2f1e6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.977782] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.978041] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.978165] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.978387] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.979164] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.979522] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.979696] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.980356] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.980580] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.980715] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.981225] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e is going to be updated. [ 898.016456] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.017241] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.017368] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.018492] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.018858] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.030034] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e in Status: IN_PROGRESS for 2s [ 899.556032] env[70614]: INFO networking_nsxv3.common.synchronization [req-00119bb2-1ef0-46c5-b4a2-983e24f40314 req-7ecf1ff5-7288-4934-9b8a-5c3fc4285b29 tempest-ServersAdminNegativeTestJSON-1410393069 tempest-ServersAdminNegativeTestJSON-1410393069-project-member] Enqueued Resource ID: e8c65e5a-d52c-481c-a6b2-680dae9a4593 with Priority: HIGHEST for action security_group_members [ 899.558203] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8c65e5a-d52c-481c-a6b2-680dae9a4593 with Priority: HIGHEST for action security_group_members [ 899.559042] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8c65e5a-d52c-481c-a6b2-680dae9a4593 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.560159] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8c65e5a-d52c-481c-a6b2-680dae9a4593" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.560159] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8c65e5a-d52c-481c-a6b2-680dae9a4593" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.560159] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8c65e5a-d52c-481c-a6b2-680dae9a4593" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.560159] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.560159] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.560580] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.560580] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.560580] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.560580] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e8c65e5a-d52c-481c-a6b2-680dae9a4593',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.998853] env[70614]: INFO networking_nsxv3.common.synchronization [None req-76bb8af7-c4f5-4263-9109-41b8d3f5c2c6 None None] Enqueued Resource ID: 3b68077b-a285-4e8e-b5cd-d76e07513584 with Priority: HIGHEST for action port [ 899.999876] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b68077b-a285-4e8e-b5cd-d76e07513584 with Priority: HIGHEST for action port [ 900.001739] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-3b68077b-a285-4e8e-b5cd-d76e07513584 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.002078] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3b68077b-a285-4e8e-b5cd-d76e07513584" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.002570] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3b68077b-a285-4e8e-b5cd-d76e07513584" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.002771] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3b68077b-a285-4e8e-b5cd-d76e07513584" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.002953] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b68077b-a285-4e8e-b5cd-d76e07513584',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.042922] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e in Status: SUCCESS [ 900.043149] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e deletion is rescheduled due to dependency. [ 900.043270] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.063329] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.063443] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.063479] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.063700] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.088180] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.088180] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.088180] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.088180] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.088180] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.088180] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.088180] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8c65e5a-d52c-481c-a6b2-680dae9a4593 is going to be updated. [ 900.117472] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.117614] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.117678] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.117961] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.118117] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.129031] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8c65e5a-d52c-481c-a6b2-680dae9a4593 in Status: IN_PROGRESS for 2s [ 900.506213] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3b68077b-a285-4e8e-b5cd-d76e07513584 [ 900.506521] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.506683] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.506756] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.507716] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.507803] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.507907] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3b68077b-a285-4e8e-b5cd-d76e07513584 already deleted. [ 900.508206] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3b68077b-a285-4e8e-b5cd-d76e07513584" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.579480] env[70614]: INFO networking_nsxv3.common.synchronization [None req-094c4b0e-9dba-4249-a0a3-a785b5aabfaf tempest-AttachVolumeTestJSON-892346173 tempest-AttachVolumeTestJSON-892346173-project-member] Enqueued Resource ID: a9ca3845-322a-44b9-bb41-74f7ea3d04f7 with Priority: HIGHEST for action security_group_rules [ 900.580456] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9ca3845-322a-44b9-bb41-74f7ea3d04f7 with Priority: HIGHEST for action security_group_rules [ 900.580782] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9ca3845-322a-44b9-bb41-74f7ea3d04f7 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.580910] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9ca3845-322a-44b9-bb41-74f7ea3d04f7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.580970] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9ca3845-322a-44b9-bb41-74f7ea3d04f7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.581312] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9ca3845-322a-44b9-bb41-74f7ea3d04f7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.581312] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9ca3845-322a-44b9-bb41-74f7ea3d04f7',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.715559] env[70614]: INFO networking_nsxv3.common.synchronization [None req-c5408292-4146-411a-985e-073b072fea0d tempest-AttachVolumeTestJSON-892346173 tempest-AttachVolumeTestJSON-892346173-project-member] Enqueued Resource ID: a9ca3845-322a-44b9-bb41-74f7ea3d04f7 with Priority: HIGHEST for action security_group_rules [ 900.717105] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9ca3845-322a-44b9-bb41-74f7ea3d04f7 with Priority: HIGHEST for action security_group_rules [ 900.717105] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9ca3845-322a-44b9-bb41-74f7ea3d04f7 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.717105] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9ca3845-322a-44b9-bb41-74f7ea3d04f7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.109068] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.109249] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.109307] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.110422] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.110422] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.110422] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9ca3845-322a-44b9-bb41-74f7ea3d04f7 already deleted. [ 901.110422] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9ca3845-322a-44b9-bb41-74f7ea3d04f7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.110422] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9ca3845-322a-44b9-bb41-74f7ea3d04f7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.110422] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9ca3845-322a-44b9-bb41-74f7ea3d04f7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.110422] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9ca3845-322a-44b9-bb41-74f7ea3d04f7',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.632701] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.633080] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.633080] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.633222] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.633330] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.633427] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9ca3845-322a-44b9-bb41-74f7ea3d04f7 already deleted. [ 901.633520] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9ca3845-322a-44b9-bb41-74f7ea3d04f7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.141296] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8c65e5a-d52c-481c-a6b2-680dae9a4593 in Status: IN_PROGRESS for 4s [ 902.794362] env[70614]: INFO networking_nsxv3.common.synchronization [None req-ac3b098f-d72f-4c30-88a2-3b16733540c5 None None] Enqueued Resource ID: 48f67135-c80b-4fe4-ac2c-c91d173d62d6 with Priority: HIGHEST for action port [ 902.794362] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48f67135-c80b-4fe4-ac2c-c91d173d62d6 with Priority: HIGHEST for action port [ 902.795543] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-48f67135-c80b-4fe4-ac2c-c91d173d62d6 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.795543] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48f67135-c80b-4fe4-ac2c-c91d173d62d6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.795543] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48f67135-c80b-4fe4-ac2c-c91d173d62d6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.796695] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48f67135-c80b-4fe4-ac2c-c91d173d62d6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.796916] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48f67135-c80b-4fe4-ac2c-c91d173d62d6',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.933852] env[70614]: INFO networking_nsxv3.common.synchronization [req-f16a7c13-9f09-4cec-960f-28b3d0ced3e6 req-e9769291-eea5-40dd-afda-4ca69180d71b tempest-VolumesAdminNegativeTest-2045600642 tempest-VolumesAdminNegativeTest-2045600642-project-member] Enqueued Resource ID: b20ed1f0-7f46-40ac-882f-36a610d96a98 with Priority: HIGHEST for action security_group_members [ 902.934793] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b20ed1f0-7f46-40ac-882f-36a610d96a98 with Priority: HIGHEST for action security_group_members [ 902.939366] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-b20ed1f0-7f46-40ac-882f-36a610d96a98 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.939366] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b20ed1f0-7f46-40ac-882f-36a610d96a98" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.939366] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b20ed1f0-7f46-40ac-882f-36a610d96a98" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.939366] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b20ed1f0-7f46-40ac-882f-36a610d96a98" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.939366] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.939366] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.939366] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.940200] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.940363] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.940530] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b20ed1f0-7f46-40ac-882f-36a610d96a98',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.298923] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 48f67135-c80b-4fe4-ac2c-c91d173d62d6 [ 903.299261] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.299404] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.299483] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.299772] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.299867] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.300100] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:48f67135-c80b-4fe4-ac2c-c91d173d62d6 already deleted. [ 903.300100] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48f67135-c80b-4fe4-ac2c-c91d173d62d6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.341798] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-392 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.342023] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-392" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.342144] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-392" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.342474] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-392" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.342742] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.342910] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.345724] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.345724] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.345724] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.345724] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 903.345724] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 903.345724] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 903.345724] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 903.345724] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 903.345724] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 903.345724] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 903.364717] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 903.364877] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 903.365029] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 903.365216] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-392" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.366386] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-f311e41e-daad-42bb-bc63-3c743dc1ed7c taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.366635] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-f311e41e-daad-42bb-bc63-3c743dc1ed7c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.366730] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-f311e41e-daad-42bb-bc63-3c743dc1ed7c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.369664] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-f311e41e-daad-42bb-bc63-3c743dc1ed7c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.369664] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f311e41e-daad-42bb-bc63-3c743dc1ed7c',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.443439] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.443790] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.443790] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.444047] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.444158] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.444398] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.444505] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.444570] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.444728] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.444806] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.444904] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b20ed1f0-7f46-40ac-882f-36a610d96a98 already deleted. [ 903.445019] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b20ed1f0-7f46-40ac-882f-36a610d96a98" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.871407] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.872609] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.872609] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.872609] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.872609] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.872803] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port f311e41e-daad-42bb-bc63-3c743dc1ed7c not found, creating... [ 903.872963] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.873105] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.873230] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.873452] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.873593] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.873990] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.874363] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.874496] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.874713] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.874854] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.875073] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: f311e41e-daad-42bb-bc63-3c743dc1ed7c is going to be created. [ 903.900721] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.900721] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.900721] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.900721] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.900721] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.900721] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-f311e41e-daad-42bb-bc63-3c743dc1ed7c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.154496] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8c65e5a-d52c-481c-a6b2-680dae9a4593 in Status: SUCCESS [ 904.154496] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8c65e5a-d52c-481c-a6b2-680dae9a4593 deletion is rescheduled due to dependency. [ 904.154496] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8c65e5a-d52c-481c-a6b2-680dae9a4593" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.191437] env[70614]: INFO networking_nsxv3.common.synchronization [req-f16a7c13-9f09-4cec-960f-28b3d0ced3e6 req-719b2c2d-5fba-4715-ad71-0f8a604bf1da service nova] Enqueued Resource ID: b20ed1f0-7f46-40ac-882f-36a610d96a98 with Priority: HIGHEST for action security_group_rules [ 905.191777] env[70614]: INFO networking_nsxv3.common.synchronization [req-f16a7c13-9f09-4cec-960f-28b3d0ced3e6 req-719b2c2d-5fba-4715-ad71-0f8a604bf1da service nova] Enqueued Resource ID: b20ed1f0-7f46-40ac-882f-36a610d96a98 with Priority: HIGHEST for action security_group_members [ 905.191915] env[70614]: INFO networking_nsxv3.common.synchronization [req-f16a7c13-9f09-4cec-960f-28b3d0ced3e6 req-719b2c2d-5fba-4715-ad71-0f8a604bf1da service nova] Enqueued Resource ID: f311e41e-daad-42bb-bc63-3c743dc1ed7c with Priority: HIGHEST for action port [ 905.193149] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b20ed1f0-7f46-40ac-882f-36a610d96a98 with Priority: HIGHEST for action security_group_rules [ 905.193299] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b20ed1f0-7f46-40ac-882f-36a610d96a98 with Priority: HIGHEST for action security_group_members [ 905.194569] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f311e41e-daad-42bb-bc63-3c743dc1ed7c with Priority: HIGHEST for action port [ 905.195205] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b20ed1f0-7f46-40ac-882f-36a610d96a98 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.195367] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b20ed1f0-7f46-40ac-882f-36a610d96a98" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.195537] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b20ed1f0-7f46-40ac-882f-36a610d96a98" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.195791] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b20ed1f0-7f46-40ac-882f-36a610d96a98" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.195791] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b20ed1f0-7f46-40ac-882f-36a610d96a98',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.196616] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-b20ed1f0-7f46-40ac-882f-36a610d96a98 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.196747] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b20ed1f0-7f46-40ac-882f-36a610d96a98" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.197220] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b20ed1f0-7f46-40ac-882f-36a610d96a98" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.197220] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b20ed1f0-7f46-40ac-882f-36a610d96a98" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.200278] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.201447] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.202365] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.202581] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.202684] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.202908] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b20ed1f0-7f46-40ac-882f-36a610d96a98',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.205185] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-f311e41e-daad-42bb-bc63-3c743dc1ed7c taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.205331] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f311e41e-daad-42bb-bc63-3c743dc1ed7c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.205405] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f311e41e-daad-42bb-bc63-3c743dc1ed7c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.205581] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f311e41e-daad-42bb-bc63-3c743dc1ed7c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.205876] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f311e41e-daad-42bb-bc63-3c743dc1ed7c',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.463122] env[70614]: INFO networking_nsxv3.common.synchronization [None req-135abbb1-d198-4a33-9992-e35da4b7299a None None] Enqueued Resource ID: 5171b62f-d942-4b42-8640-5d6d0ca283c7 with Priority: HIGHEST for action port [ 905.463736] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5171b62f-d942-4b42-8640-5d6d0ca283c7 with Priority: HIGHEST for action port [ 905.464611] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-5171b62f-d942-4b42-8640-5d6d0ca283c7 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.466095] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5171b62f-d942-4b42-8640-5d6d0ca283c7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.466229] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5171b62f-d942-4b42-8640-5d6d0ca283c7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.466619] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5171b62f-d942-4b42-8640-5d6d0ca283c7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.466745] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5171b62f-d942-4b42-8640-5d6d0ca283c7',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.705558] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b20ed1f0-7f46-40ac-882f-36a610d96a98',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.711125] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-b20ed1f0-7f46-40ac-882f-36a610d96a98 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.711125] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b20ed1f0-7f46-40ac-882f-36a610d96a98" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.711125] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f311e41e-daad-42bb-bc63-3c743dc1ed7c with status ACTIVE [ 905.711125] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.711125] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.711125] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.711125] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.711125] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.711125] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.711125] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.711125] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.711125] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.711125] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.711125] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.711924] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.711924] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.711924] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.711924] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.711924] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f311e41e-daad-42bb-bc63-3c743dc1ed7c is going to be updated. [ 905.738204] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.738385] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.738385] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.738635] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.738793] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.739022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f311e41e-daad-42bb-bc63-3c743dc1ed7c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.906845] env[70614]: INFO networking_nsxv3.common.synchronization [req-f492e486-aa39-469c-949e-329fd1283a53 req-163724e2-2208-40ac-8cad-bae4622d731d tempest-ImagesTestJSON-1765947257 tempest-ImagesTestJSON-1765947257-project-member] Enqueued Resource ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 with Priority: HIGHEST for action security_group_members [ 905.907559] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 with Priority: HIGHEST for action security_group_members [ 905.907923] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-04a082fe-52f7-4ac6-a12b-63791c63be86 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.908438] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.908621] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.908955] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.909214] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.910601] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.910727] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.911082] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.911237] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.911391] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04a082fe-52f7-4ac6-a12b-63791c63be86',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.969610] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5171b62f-d942-4b42-8640-5d6d0ca283c7 [ 905.969962] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.970163] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.970274] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.970531] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.970687] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.970895] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5171b62f-d942-4b42-8640-5d6d0ca283c7 already deleted. [ 905.971057] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5171b62f-d942-4b42-8640-5d6d0ca283c7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.208649] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b20ed1f0-7f46-40ac-882f-36a610d96a98',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.413376] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.413553] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.413627] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.413840] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.413930] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.414145] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.414249] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.415074] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.415074] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.415074] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.415074] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 is going to be updated. [ 906.469057] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.469057] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.469057] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.470045] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.470045] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.482575] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 in Status: IN_PROGRESS for 2s [ 906.711386] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.711545] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.711621] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.711837] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.711927] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.712038] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b20ed1f0-7f46-40ac-882f-36a610d96a98 is going to be created. [ 906.738223] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.738384] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.738446] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.738683] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.738868] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.749373] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b20ed1f0-7f46-40ac-882f-36a610d96a98 in Status: UNINITIALIZED for 2s [ 907.666282] env[70614]: INFO networking_nsxv3.common.synchronization [None req-c3c54a99-3c18-4560-bda6-9af0823a6257 None None] Enqueued Resource ID: b04c7088-b374-4e0e-85b4-d41c7181edd5 with Priority: HIGHEST for action port [ 907.666831] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b04c7088-b374-4e0e-85b4-d41c7181edd5 with Priority: HIGHEST for action port [ 907.667201] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-b04c7088-b374-4e0e-85b4-d41c7181edd5 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.667320] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b04c7088-b374-4e0e-85b4-d41c7181edd5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.667389] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b04c7088-b374-4e0e-85b4-d41c7181edd5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.667654] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b04c7088-b374-4e0e-85b4-d41c7181edd5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.667735] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b04c7088-b374-4e0e-85b4-d41c7181edd5',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.171252] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b04c7088-b374-4e0e-85b4-d41c7181edd5 [ 908.171252] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.171252] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.171372] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.172147] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.172311] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.172450] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b04c7088-b374-4e0e-85b4-d41c7181edd5 already deleted. [ 908.172550] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b04c7088-b374-4e0e-85b4-d41c7181edd5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.492321] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 in Status: SUCCESS [ 908.492586] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 deletion is rescheduled due to dependency. [ 908.492769] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.759910] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b20ed1f0-7f46-40ac-882f-36a610d96a98 in Status: SUCCESS [ 908.760248] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b20ed1f0-7f46-40ac-882f-36a610d96a98" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.760501] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b20ed1f0-7f46-40ac-882f-36a610d96a98" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.760864] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b20ed1f0-7f46-40ac-882f-36a610d96a98" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.761055] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.761220] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.761286] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.761473] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.761583] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.761696] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b20ed1f0-7f46-40ac-882f-36a610d96a98" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.761841] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b20ed1f0-7f46-40ac-882f-36a610d96a98',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.265329] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b20ed1f0-7f46-40ac-882f-36a610d96a98',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.770156] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b20ed1f0-7f46-40ac-882f-36a610d96a98: rpc.has_security_group_logging(os_id): False [ 909.791202] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.791202] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.791394] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.795042] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.795042] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.795042] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.795042] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.795042] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.795042] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.795042] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.795042] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b20ed1f0-7f46-40ac-882f-36a610d96a98 is going to be created. [ 909.882753] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.882950] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.883063] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.884033] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.884033] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.894282] env[70614]: INFO networking_nsxv3.common.synchronization [req-aade3e40-5ccb-4081-b66b-14deb089bd66 req-d1224d9f-bba6-4e93-bbda-9a005959383c tempest-ServersAdminTestJSON-365827888 tempest-ServersAdminTestJSON-365827888-project-member] Enqueued Resource ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b with Priority: HIGHEST for action security_group_members [ 909.895027] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b with Priority: HIGHEST for action security_group_members [ 909.895322] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.895479] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.895606] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.895752] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.896114] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.896892] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.896892] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.896892] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.897091] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.897225] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.899600] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b20ed1f0-7f46-40ac-882f-36a610d96a98 in Status: IN_PROGRESS for 2s [ 910.110425] env[70614]: INFO networking_nsxv3.common.synchronization [req-c5bb2526-3ba2-4477-bfa5-b3ac185d736d req-11a9e9af-3a0a-48af-bc62-228e1b1fa31f tempest-AttachInterfacesUnderV243Test-10932585 tempest-AttachInterfacesUnderV243Test-10932585-project-member] Enqueued Resource ID: e744e9f1-b15c-4958-bd6f-1c34e15652a8 with Priority: HIGHEST for action security_group_members [ 910.111697] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e744e9f1-b15c-4958-bd6f-1c34e15652a8 with Priority: HIGHEST for action security_group_members [ 910.111697] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-e744e9f1-b15c-4958-bd6f-1c34e15652a8 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.111697] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e744e9f1-b15c-4958-bd6f-1c34e15652a8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.111697] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e744e9f1-b15c-4958-bd6f-1c34e15652a8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.111895] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e744e9f1-b15c-4958-bd6f-1c34e15652a8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.112048] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.112172] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.112243] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.112401] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.112486] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.112585] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e744e9f1-b15c-4958-bd6f-1c34e15652a8',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.355966] env[70614]: INFO networking_nsxv3.common.synchronization [req-950b64a9-1771-4e4f-a3ee-952a697ac5b0 req-f78d1d69-02cd-4f80-8313-245860a4820a tempest-ServerRescueTestJSON-1696153379 tempest-ServerRescueTestJSON-1696153379-project-member] Enqueued Resource ID: 0a55332f-b291-4614-8b34-ee4cd0d39027 with Priority: HIGHEST for action security_group_members [ 910.357088] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a55332f-b291-4614-8b34-ee4cd0d39027 with Priority: HIGHEST for action security_group_members [ 910.357088] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a55332f-b291-4614-8b34-ee4cd0d39027 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.357088] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.357253] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.357365] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.357518] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.357617] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.357681] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.357824] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.358373] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.358373] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a55332f-b291-4614-8b34-ee4cd0d39027',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.401615] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.521632] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-757 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.521632] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-757" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.521632] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-757" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.521632] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-757" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.521849] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.521940] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.522033] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.522548] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.522548] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.522671] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 910.522715] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 910.522834] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 910.522923] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 910.523042] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 910.523178] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 910.523277] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 910.542703] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 910.542703] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 910.542905] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 910.543094] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-757" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.543480] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-39e7649e-b82e-48aa-9542-c7c252eff660 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.543718] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-39e7649e-b82e-48aa-9542-c7c252eff660" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.543857] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-39e7649e-b82e-48aa-9542-c7c252eff660" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.544205] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-39e7649e-b82e-48aa-9542-c7c252eff660" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.544351] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39e7649e-b82e-48aa-9542-c7c252eff660',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.616205] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.616725] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.616725] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.616893] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.617070] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.617320] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.617433] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.617523] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.617671] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.617751] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.617840] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e744e9f1-b15c-4958-bd6f-1c34e15652a8 already deleted. [ 910.617988] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e744e9f1-b15c-4958-bd6f-1c34e15652a8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.860726] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.861128] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.861128] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.861289] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.861387] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.861641] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.861849] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.861849] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.862013] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.862099] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.862221] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a55332f-b291-4614-8b34-ee4cd0d39027 is going to be updated. [ 910.894167] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.895096] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.895096] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.895096] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.895096] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.903900] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.906565] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a55332f-b291-4614-8b34-ee4cd0d39027 in Status: IN_PROGRESS for 2s [ 911.047457] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.047693] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.047824] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.048156] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.048322] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.048575] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 39e7649e-b82e-48aa-9542-c7c252eff660 not found, creating... [ 911.048935] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.049043] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.049196] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.049433] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.049585] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.049914] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.050160] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.050250] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.050472] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.050611] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.050772] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 39e7649e-b82e-48aa-9542-c7c252eff660 is going to be created. [ 911.072617] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.072874] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.073120] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.073428] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.073670] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.073927] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-39e7649e-b82e-48aa-9542-c7c252eff660" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.409732] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.409996] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.410131] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.410473] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.410627] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.410798] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b is going to be updated. [ 911.447963] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.448341] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.448341] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.448583] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.448784] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.458924] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b in Status: IN_PROGRESS for 2s [ 911.912867] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b20ed1f0-7f46-40ac-882f-36a610d96a98 in Status: SUCCESS [ 911.913209] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b20ed1f0-7f46-40ac-882f-36a610d96a98" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.144051] env[70614]: INFO networking_nsxv3.common.synchronization [req-c5bb2526-3ba2-4477-bfa5-b3ac185d736d req-24854edf-d12d-41fa-a587-58b4e0acb49f service nova] Enqueued Resource ID: e744e9f1-b15c-4958-bd6f-1c34e15652a8 with Priority: HIGHEST for action security_group_rules [ 912.144269] env[70614]: INFO networking_nsxv3.common.synchronization [req-c5bb2526-3ba2-4477-bfa5-b3ac185d736d req-24854edf-d12d-41fa-a587-58b4e0acb49f service nova] Enqueued Resource ID: e744e9f1-b15c-4958-bd6f-1c34e15652a8 with Priority: HIGHEST for action security_group_members [ 912.144481] env[70614]: INFO networking_nsxv3.common.synchronization [req-c5bb2526-3ba2-4477-bfa5-b3ac185d736d req-24854edf-d12d-41fa-a587-58b4e0acb49f service nova] Enqueued Resource ID: 39e7649e-b82e-48aa-9542-c7c252eff660 with Priority: HIGHEST for action port [ 912.145093] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e744e9f1-b15c-4958-bd6f-1c34e15652a8 with Priority: HIGHEST for action security_group_rules [ 912.145237] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e744e9f1-b15c-4958-bd6f-1c34e15652a8 with Priority: HIGHEST for action security_group_members [ 912.145339] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39e7649e-b82e-48aa-9542-c7c252eff660 with Priority: HIGHEST for action port [ 912.145627] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e744e9f1-b15c-4958-bd6f-1c34e15652a8 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.145753] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e744e9f1-b15c-4958-bd6f-1c34e15652a8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.145821] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e744e9f1-b15c-4958-bd6f-1c34e15652a8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.146040] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e744e9f1-b15c-4958-bd6f-1c34e15652a8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.146141] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e744e9f1-b15c-4958-bd6f-1c34e15652a8',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.147320] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-e744e9f1-b15c-4958-bd6f-1c34e15652a8 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.147320] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e744e9f1-b15c-4958-bd6f-1c34e15652a8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.147582] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e744e9f1-b15c-4958-bd6f-1c34e15652a8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.147582] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e744e9f1-b15c-4958-bd6f-1c34e15652a8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.147681] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.147830] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.147830] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.147939] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.148036] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.148127] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e744e9f1-b15c-4958-bd6f-1c34e15652a8',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.149198] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-39e7649e-b82e-48aa-9542-c7c252eff660 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.149447] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-39e7649e-b82e-48aa-9542-c7c252eff660" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.149447] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-39e7649e-b82e-48aa-9542-c7c252eff660" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.149553] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-39e7649e-b82e-48aa-9542-c7c252eff660" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.149597] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39e7649e-b82e-48aa-9542-c7c252eff660',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.652193] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-e744e9f1-b15c-4958-bd6f-1c34e15652a8 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.652193] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e744e9f1-b15c-4958-bd6f-1c34e15652a8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.652193] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e744e9f1-b15c-4958-bd6f-1c34e15652a8',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.653170] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 39e7649e-b82e-48aa-9542-c7c252eff660 with status ACTIVE [ 912.653370] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.653488] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.653576] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.653770] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.653845] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.654011] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.654220] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.654220] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.654424] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.654424] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.654563] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.654667] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.654721] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.654856] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.655099] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.655099] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 39e7649e-b82e-48aa-9542-c7c252eff660 is going to be updated. [ 912.683550] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.683710] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.683784] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.683999] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.684160] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.684397] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-39e7649e-b82e-48aa-9542-c7c252eff660" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.919874] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a55332f-b291-4614-8b34-ee4cd0d39027 in Status: SUCCESS [ 912.919874] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a55332f-b291-4614-8b34-ee4cd0d39027 deletion is rescheduled due to dependency. [ 912.920218] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.157486] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e744e9f1-b15c-4958-bd6f-1c34e15652a8',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.469725] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b in Status: SUCCESS [ 913.469725] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.660698] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.660880] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.660965] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.661213] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.661317] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.661460] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e744e9f1-b15c-4958-bd6f-1c34e15652a8 is going to be created. [ 913.686442] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.686442] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.686567] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.686770] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.686932] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.698057] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e744e9f1-b15c-4958-bd6f-1c34e15652a8 in Status: UNINITIALIZED for 2s [ 915.711220] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e744e9f1-b15c-4958-bd6f-1c34e15652a8 in Status: SUCCESS [ 915.711583] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e744e9f1-b15c-4958-bd6f-1c34e15652a8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.711844] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e744e9f1-b15c-4958-bd6f-1c34e15652a8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.712200] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e744e9f1-b15c-4958-bd6f-1c34e15652a8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.712480] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.712681] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.712796] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.713040] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.713171] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.713332] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e744e9f1-b15c-4958-bd6f-1c34e15652a8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.713479] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e744e9f1-b15c-4958-bd6f-1c34e15652a8',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.719760] env[70614]: INFO networking_nsxv3.common.synchronization [req-634512d0-c44e-4c52-851a-f90bf8b87d41 req-d7617008-49b2-4d4a-ba8b-032dbcf9e833 tempest-ServersTestMultiNic-1290380047 tempest-ServersTestMultiNic-1290380047-project-member] Enqueued Resource ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 with Priority: HIGHEST for action security_group_members [ 915.720341] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 with Priority: HIGHEST for action security_group_members [ 915.721315] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.721315] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.721918] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.722264] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.722496] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.723767] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.723767] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.724641] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.724709] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.724864] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.130773] env[70614]: INFO networking_nsxv3.common.synchronization [req-634512d0-c44e-4c52-851a-f90bf8b87d41 req-5558d9b3-eebe-44bc-9259-88ddc31936dc tempest-ServersTestMultiNic-1290380047 tempest-ServersTestMultiNic-1290380047-project-member] Enqueued Resource ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 with Priority: HIGHEST for action security_group_members [ 916.131398] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 with Priority: HIGHEST for action security_group_members [ 916.131717] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.131839] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.218883] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e744e9f1-b15c-4958-bd6f-1c34e15652a8',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.230776] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.230776] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.230776] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.230776] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.230776] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.230776] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.230776] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.230776] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.230776] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.230776] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.230776] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 already deleted. [ 916.230776] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.230776] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.230776] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.231721] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.231721] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.231721] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.231721] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.231721] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.231721] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.554315] env[70614]: INFO networking_nsxv3.common.synchronization [req-634512d0-c44e-4c52-851a-f90bf8b87d41 req-c3f37b8a-d156-439a-8b65-d11b709ad685 tempest-ServersTestMultiNic-1290380047 tempest-ServersTestMultiNic-1290380047-project-member] Enqueued Resource ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 with Priority: HIGHEST for action security_group_members [ 916.554870] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 with Priority: HIGHEST for action security_group_members [ 916.556754] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.556754] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.723564] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e744e9f1-b15c-4958-bd6f-1c34e15652a8: rpc.has_security_group_logging(os_id): False [ 916.733432] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.733601] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.733718] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.733857] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.734829] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.734829] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.734829] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.734829] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.734829] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.734829] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.734829] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 already deleted. [ 916.734829] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.734829] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.735309] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.735309] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.735309] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.735409] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.735520] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.735607] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.735687] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.742269] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.742417] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.742491] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.742688] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.742788] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.743073] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.743198] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.743265] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.743448] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.743569] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.743610] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e744e9f1-b15c-4958-bd6f-1c34e15652a8 is going to be created. [ 916.805954] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.805954] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.805954] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.805954] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.805954] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.828232] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e744e9f1-b15c-4958-bd6f-1c34e15652a8 in Status: IN_PROGRESS for 2s [ 916.986920] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-770 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.987567] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-770" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.987567] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-770" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.988093] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-770" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.988536] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.988825] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.989502] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.989502] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.989614] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.990074] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 916.990141] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 916.990675] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 916.990675] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 916.990847] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 916.991059] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 916.991363] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 917.023291] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 917.023475] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 917.023617] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 917.023831] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-770" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.024737] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-80c1b4a4-402c-48eb-b971-d8a25d2e3581 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.024737] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-80c1b4a4-402c-48eb-b971-d8a25d2e3581" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.024737] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-80c1b4a4-402c-48eb-b971-d8a25d2e3581" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.025019] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-80c1b4a4-402c-48eb-b971-d8a25d2e3581" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.025168] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('80c1b4a4-402c-48eb-b971-d8a25d2e3581',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.241066] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.241320] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.241358] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.241555] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.241639] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.241848] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.241935] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.242017] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.242169] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.242252] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.242340] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 already deleted. [ 917.242420] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.528412] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.528701] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.528845] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.529219] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.529388] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.529559] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 80c1b4a4-402c-48eb-b971-d8a25d2e3581 not found, creating... [ 917.529901] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.530106] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.530232] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.530469] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.530617] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.530908] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.531171] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.531267] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.531474] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.531612] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.531760] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 80c1b4a4-402c-48eb-b971-d8a25d2e3581 is going to be created. [ 917.554861] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.555236] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.555444] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.556011] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.556243] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.556615] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-80c1b4a4-402c-48eb-b971-d8a25d2e3581" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.295887] env[70614]: INFO networking_nsxv3.common.synchronization [req-634512d0-c44e-4c52-851a-f90bf8b87d41 req-476a3068-8b5c-4973-9904-547481d049cb service nova] Enqueued Resource ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 with Priority: HIGHEST for action security_group_rules [ 918.296183] env[70614]: INFO networking_nsxv3.common.synchronization [req-634512d0-c44e-4c52-851a-f90bf8b87d41 req-476a3068-8b5c-4973-9904-547481d049cb service nova] Enqueued Resource ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 with Priority: HIGHEST for action security_group_members [ 918.296223] env[70614]: INFO networking_nsxv3.common.synchronization [req-634512d0-c44e-4c52-851a-f90bf8b87d41 req-476a3068-8b5c-4973-9904-547481d049cb service nova] Enqueued Resource ID: 80c1b4a4-402c-48eb-b971-d8a25d2e3581 with Priority: HIGHEST for action port [ 918.296450] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 with Priority: HIGHEST for action security_group_rules [ 918.296572] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 with Priority: HIGHEST for action security_group_members [ 918.296689] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80c1b4a4-402c-48eb-b971-d8a25d2e3581 with Priority: HIGHEST for action port [ 918.297248] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.297373] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.297464] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.297689] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.297775] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.300899] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.300899] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.300899] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.300899] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.300899] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.300899] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.301273] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.301273] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.301493] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.301619] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.302369] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-80c1b4a4-402c-48eb-b971-d8a25d2e3581 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.302569] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-80c1b4a4-402c-48eb-b971-d8a25d2e3581" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.302569] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-80c1b4a4-402c-48eb-b971-d8a25d2e3581" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.302676] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-80c1b4a4-402c-48eb-b971-d8a25d2e3581" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.302751] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('80c1b4a4-402c-48eb-b971-d8a25d2e3581',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.804684] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.804822] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.805042] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.805939] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 80c1b4a4-402c-48eb-b971-d8a25d2e3581 with status ACTIVE [ 918.810022] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.810022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.810022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.810022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.810022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.810022] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.810022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.810022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.810022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.810022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.810022] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.810022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.810022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.810022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.810022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.810022] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 80c1b4a4-402c-48eb-b971-d8a25d2e3581 is going to be updated. [ 918.830404] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.830623] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.830623] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.830915] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.830992] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.831204] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-80c1b4a4-402c-48eb-b971-d8a25d2e3581" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.844376] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e744e9f1-b15c-4958-bd6f-1c34e15652a8 in Status: SUCCESS [ 918.844676] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e744e9f1-b15c-4958-bd6f-1c34e15652a8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.884253] env[70614]: INFO networking_nsxv3.common.synchronization [req-b9941369-22d5-40eb-985b-6267041cae0a req-d9a9f586-a517-4c50-8941-baa51fdd3ab4 tempest-ServersWithSpecificFlavorTestJSON-1815410269 tempest-ServersWithSpecificFlavorTestJSON-1815410269-project-member] Enqueued Resource ID: ca9b1416-779b-4bc5-ae29-5117ebb9bc1a with Priority: HIGHEST for action security_group_members [ 918.884999] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca9b1416-779b-4bc5-ae29-5117ebb9bc1a with Priority: HIGHEST for action security_group_members [ 918.885326] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.885439] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.885500] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.885828] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.885828] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.886072] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.886072] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.890568] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.890662] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.890783] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca9b1416-779b-4bc5-ae29-5117ebb9bc1a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.954263] env[70614]: INFO networking_nsxv3.common.synchronization [req-1df48aab-4406-4acb-b974-a927f1898077 req-62e0c583-7fc5-4ac5-9667-3caf74747f24 tempest-AttachInterfacesTestJSON-1919943007 tempest-AttachInterfacesTestJSON-1919943007-project-member] Enqueued Resource ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 with Priority: HIGHEST for action security_group_members [ 918.954897] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 with Priority: HIGHEST for action security_group_members [ 918.955804] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d3a5ad0-c473-4d61-9101-9c7582c27390 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.955944] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.956028] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.956242] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.956514] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.956725] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.956808] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.956980] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.957089] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.957217] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d3a5ad0-c473-4d61-9101-9c7582c27390',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.310097] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.332265] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-404 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.332265] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-404" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.332265] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-404" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.332637] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-404" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.333975] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.333975] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.333975] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.334353] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.334812] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.335188] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 919.335405] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 919.335675] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 919.335893] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 919.336111] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 919.336225] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 919.336399] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 919.359384] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 919.359501] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 919.359755] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 919.360056] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-404" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.360239] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-d803ed6c-d578-4dce-bf5b-1fa0516d0dd8 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.361793] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-d803ed6c-d578-4dce-bf5b-1fa0516d0dd8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.362042] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-d803ed6c-d578-4dce-bf5b-1fa0516d0dd8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.362450] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-d803ed6c-d578-4dce-bf5b-1fa0516d0dd8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.362532] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d803ed6c-d578-4dce-bf5b-1fa0516d0dd8',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.396759] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.397198] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.397198] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.397198] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.397337] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.397465] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.397557] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.397714] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.397773] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.397825] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.397905] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca9b1416-779b-4bc5-ae29-5117ebb9bc1a is going to be updated. [ 919.430956] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.430956] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.430956] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.430956] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.430956] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.440116] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca9b1416-779b-4bc5-ae29-5117ebb9bc1a in Status: IN_PROGRESS for 2s [ 919.463024] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.463024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.463024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.463024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.463024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.463024] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.463024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.463024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.463024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.463024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.463024] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 is going to be deleted. [ 919.509489] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.509489] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.509489] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.509489] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.509489] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.509489] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.791871] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-385 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.793148] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-385" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.793148] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-385" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.793148] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-385" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.793148] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.793412] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.793412] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.793758] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.793843] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.794020] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 919.794765] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 919.794765] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 919.794765] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 919.794765] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 919.794765] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 919.794765] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 919.812689] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.813038] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.813038] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.813400] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.813525] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.813633] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 is going to be created. [ 919.818496] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 919.818731] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 919.818902] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 919.819111] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-385" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.820586] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-43dce9eb-e3cf-4292-a531-2e0bd1329411 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.820881] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-43dce9eb-e3cf-4292-a531-2e0bd1329411" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.821092] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-43dce9eb-e3cf-4292-a531-2e0bd1329411" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.821558] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-43dce9eb-e3cf-4292-a531-2e0bd1329411" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.821776] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43dce9eb-e3cf-4292-a531-2e0bd1329411',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.840631] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.840841] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.840841] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.841159] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.841382] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.855355] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 in Status: UNINITIALIZED for 2s [ 919.868982] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.869825] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.870036] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.870406] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.870804] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.870804] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port d803ed6c-d578-4dce-bf5b-1fa0516d0dd8 not found, creating... [ 919.871296] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.871498] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.871605] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.871840] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.871989] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.872539] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.872910] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.875098] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.875098] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.875098] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.875098] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: d803ed6c-d578-4dce-bf5b-1fa0516d0dd8 is going to be created. [ 919.895921] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.896963] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.897199] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.897581] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.897844] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.898202] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-d803ed6c-d578-4dce-bf5b-1fa0516d0dd8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.324627] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.324931] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.324931] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.325222] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.325376] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.325540] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 43dce9eb-e3cf-4292-a531-2e0bd1329411 not found, creating... [ 920.325809] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.325979] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.326122] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.326369] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.326511] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.326848] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.330535] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.330772] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.331145] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.331474] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.331614] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 43dce9eb-e3cf-4292-a531-2e0bd1329411 is going to be created. [ 920.360387] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.360717] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.363582] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.363582] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.363582] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.363582] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-43dce9eb-e3cf-4292-a531-2e0bd1329411" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.072598] env[70614]: INFO networking_nsxv3.common.synchronization [req-634512d0-c44e-4c52-851a-f90bf8b87d41 req-e87ed1f3-fd0c-409d-9b71-25306173f0b7 service nova] Enqueued Resource ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 with Priority: HIGHEST for action security_group_rules [ 921.072666] env[70614]: INFO networking_nsxv3.common.synchronization [req-634512d0-c44e-4c52-851a-f90bf8b87d41 req-e87ed1f3-fd0c-409d-9b71-25306173f0b7 service nova] Enqueued Resource ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 with Priority: HIGHEST for action security_group_members [ 921.072805] env[70614]: INFO networking_nsxv3.common.synchronization [req-634512d0-c44e-4c52-851a-f90bf8b87d41 req-e87ed1f3-fd0c-409d-9b71-25306173f0b7 service nova] Enqueued Resource ID: d803ed6c-d578-4dce-bf5b-1fa0516d0dd8 with Priority: HIGHEST for action port [ 921.073049] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 with Priority: HIGHEST for action security_group_rules [ 921.073173] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 with Priority: HIGHEST for action security_group_members [ 921.073263] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d803ed6c-d578-4dce-bf5b-1fa0516d0dd8 with Priority: HIGHEST for action port [ 921.073988] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.073988] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.074214] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.074254] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.074524] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-d803ed6c-d578-4dce-bf5b-1fa0516d0dd8 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.074606] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d803ed6c-d578-4dce-bf5b-1fa0516d0dd8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.074672] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d803ed6c-d578-4dce-bf5b-1fa0516d0dd8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.074875] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d803ed6c-d578-4dce-bf5b-1fa0516d0dd8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.074955] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d803ed6c-d578-4dce-bf5b-1fa0516d0dd8',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.230637] env[70614]: INFO networking_nsxv3.common.synchronization [req-1df48aab-4406-4acb-b974-a927f1898077 req-d491d92c-64c3-4381-8581-fec8fd0d5825 service nova] Enqueued Resource ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 with Priority: HIGHEST for action security_group_rules [ 921.230637] env[70614]: INFO networking_nsxv3.common.synchronization [req-1df48aab-4406-4acb-b974-a927f1898077 req-d491d92c-64c3-4381-8581-fec8fd0d5825 service nova] Enqueued Resource ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 with Priority: HIGHEST for action security_group_members [ 921.230637] env[70614]: INFO networking_nsxv3.common.synchronization [req-1df48aab-4406-4acb-b974-a927f1898077 req-d491d92c-64c3-4381-8581-fec8fd0d5825 service nova] Enqueued Resource ID: 43dce9eb-e3cf-4292-a531-2e0bd1329411 with Priority: HIGHEST for action port [ 921.230637] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 with Priority: HIGHEST for action security_group_rules [ 921.230637] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 with Priority: HIGHEST for action security_group_members [ 921.230637] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43dce9eb-e3cf-4292-a531-2e0bd1329411 with Priority: HIGHEST for action port [ 921.231651] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d3a5ad0-c473-4d61-9101-9c7582c27390 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.235891] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.235891] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.235891] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.235891] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d3a5ad0-c473-4d61-9101-9c7582c27390',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.235891] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d3a5ad0-c473-4d61-9101-9c7582c27390 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.236160] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.236160] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.236330] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.236741] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.236741] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.236741] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.236741] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.236934] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.236934] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d3a5ad0-c473-4d61-9101-9c7582c27390',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.238120] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-43dce9eb-e3cf-4292-a531-2e0bd1329411 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.238211] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-43dce9eb-e3cf-4292-a531-2e0bd1329411" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.238211] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-43dce9eb-e3cf-4292-a531-2e0bd1329411" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.239038] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-43dce9eb-e3cf-4292-a531-2e0bd1329411" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.239038] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43dce9eb-e3cf-4292-a531-2e0bd1329411',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.449869] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca9b1416-779b-4bc5-ae29-5117ebb9bc1a in Status: SUCCESS [ 921.450245] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca9b1416-779b-4bc5-ae29-5117ebb9bc1a deletion is rescheduled due to dependency. [ 921.450303] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.579070] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d803ed6c-d578-4dce-bf5b-1fa0516d0dd8 with status ACTIVE [ 921.579212] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.579356] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.579424] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.579911] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.580022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.580226] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.580333] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.580505] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.580580] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.580869] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.580869] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.580951] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.580978] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.581131] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.581202] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.581297] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d803ed6c-d578-4dce-bf5b-1fa0516d0dd8 is going to be updated. [ 921.607803] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.607803] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.607803] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.607954] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.607981] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.608381] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d803ed6c-d578-4dce-bf5b-1fa0516d0dd8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.740905] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d3a5ad0-c473-4d61-9101-9c7582c27390 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.741112] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.741326] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d3a5ad0-c473-4d61-9101-9c7582c27390',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.742262] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 43dce9eb-e3cf-4292-a531-2e0bd1329411 with status ACTIVE [ 921.746710] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.746710] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.746710] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.746710] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.746710] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.746710] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.746710] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.746710] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.746710] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.746710] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.746710] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.746710] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.746710] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.746710] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.746710] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.746710] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 43dce9eb-e3cf-4292-a531-2e0bd1329411 is going to be updated. [ 921.777291] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.777460] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.777537] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.777769] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.777909] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.778099] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-43dce9eb-e3cf-4292-a531-2e0bd1329411" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.881678] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-770 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.881902] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-770" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.882033] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-770" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.882307] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-770" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.882679] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.882860] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.883013] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.884636] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.884819] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.885074] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 921.885201] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 921.885516] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 921.886187] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 921.886378] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 921.886912] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 921.886912] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 921.888831] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 in Status: SUCCESS [ 921.889055] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.890137] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.890760] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.891751] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.891751] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.891751] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.891751] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.891751] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.891751] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.892062] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.896528] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.896921] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.897142] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.897595] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.897595] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.897595] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.897595] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.897738] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.934923] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 921.937023] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.049 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 921.937023] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 921.937023] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-770" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.937023] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-a8bf4122-a9fc-4364-a4fb-9ffbe4818c43 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.937023] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-a8bf4122-a9fc-4364-a4fb-9ffbe4818c43" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.937023] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-a8bf4122-a9fc-4364-a4fb-9ffbe4818c43" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.937534] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-a8bf4122-a9fc-4364-a4fb-9ffbe4818c43" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.937854] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8bf4122-a9fc-4364-a4fb-9ffbe4818c43',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.247859] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d3a5ad0-c473-4d61-9101-9c7582c27390',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.400353] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.400993] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.401427] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.441092] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.441948] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.442137] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.442440] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.442597] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.442800] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port a8bf4122-a9fc-4364-a4fb-9ffbe4818c43 not found, creating... [ 922.443128] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.443317] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.443459] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.443709] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.443850] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.444375] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.444629] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.444791] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.445100] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.445281] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.445496] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: a8bf4122-a9fc-4364-a4fb-9ffbe4818c43 is going to be created. [ 922.468811] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.469206] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.469281] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.469574] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.469906] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.470217] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-a8bf4122-a9fc-4364-a4fb-9ffbe4818c43" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.752173] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.752173] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.752173] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.752173] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.752173] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.752173] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 is going to be created. [ 922.781178] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.781329] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.781399] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.781641] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.781824] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.795075] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 in Status: UNINITIALIZED for 2s [ 922.905140] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.134350] env[70614]: INFO networking_nsxv3.common.synchronization [req-634512d0-c44e-4c52-851a-f90bf8b87d41 req-31830c23-afde-4bed-8956-2d5a9bc31c41 service nova] Enqueued Resource ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 with Priority: HIGHEST for action security_group_rules [ 923.134501] env[70614]: INFO networking_nsxv3.common.synchronization [req-634512d0-c44e-4c52-851a-f90bf8b87d41 req-31830c23-afde-4bed-8956-2d5a9bc31c41 service nova] Enqueued Resource ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 with Priority: HIGHEST for action security_group_members [ 923.134640] env[70614]: INFO networking_nsxv3.common.synchronization [req-634512d0-c44e-4c52-851a-f90bf8b87d41 req-31830c23-afde-4bed-8956-2d5a9bc31c41 service nova] Enqueued Resource ID: a8bf4122-a9fc-4364-a4fb-9ffbe4818c43 with Priority: HIGHEST for action port [ 923.134874] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 with Priority: HIGHEST for action security_group_rules [ 923.134997] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 with Priority: HIGHEST for action security_group_members [ 923.135105] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8bf4122-a9fc-4364-a4fb-9ffbe4818c43 with Priority: HIGHEST for action port [ 923.135648] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.135753] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.135940] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.136034] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.136253] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-a8bf4122-a9fc-4364-a4fb-9ffbe4818c43 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.136367] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a8bf4122-a9fc-4364-a4fb-9ffbe4818c43" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.136432] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a8bf4122-a9fc-4364-a4fb-9ffbe4818c43" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.136667] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a8bf4122-a9fc-4364-a4fb-9ffbe4818c43" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.136758] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8bf4122-a9fc-4364-a4fb-9ffbe4818c43',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.409063] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.409063] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.409063] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.409063] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.409063] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.409063] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 is going to be updated. [ 923.437277] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.437481] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.437481] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.437694] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.437838] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.447695] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 in Status: IN_PROGRESS for 2s [ 923.638965] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a8bf4122-a9fc-4364-a4fb-9ffbe4818c43 with status ACTIVE [ 923.639312] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.639398] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.639450] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.639636] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.639736] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.640366] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.640366] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.640366] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.640366] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.640366] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.640584] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.640584] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.640708] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.640770] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.640797] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.640893] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a8bf4122-a9fc-4364-a4fb-9ffbe4818c43 is going to be updated. [ 923.668374] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.668686] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.668784] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.668996] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.669269] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.669554] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a8bf4122-a9fc-4364-a4fb-9ffbe4818c43" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.808032] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 in Status: SUCCESS [ 924.808032] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.808577] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.808577] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.808577] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.808751] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.808751] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.809023] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.809076] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.809875] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.809875] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6d3a5ad0-c473-4d61-9101-9c7582c27390',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.829144] env[70614]: INFO networking_nsxv3.common.synchronization [None req-5b8dec04-7119-4f5a-b2dd-bce93eaf9bc9 None None] Enqueued Resource ID: 5c58baef-aefa-4971-bade-2a331ffbeef4 with Priority: HIGHEST for action port [ 924.829854] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c58baef-aefa-4971-bade-2a331ffbeef4 with Priority: HIGHEST for action port [ 924.830116] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-5c58baef-aefa-4971-bade-2a331ffbeef4 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.830116] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5c58baef-aefa-4971-bade-2a331ffbeef4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.830270] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5c58baef-aefa-4971-bade-2a331ffbeef4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.831044] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5c58baef-aefa-4971-bade-2a331ffbeef4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.831044] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c58baef-aefa-4971-bade-2a331ffbeef4',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.312329] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d3a5ad0-c473-4d61-9101-9c7582c27390 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.312873] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.313281] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.313724] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.314041] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.314811] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.315040] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.315466] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.315684] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.316062] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.316390] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d3a5ad0-c473-4d61-9101-9c7582c27390 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.316679] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.316875] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.317317] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.317565] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.317769] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.317957] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.319814] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.319814] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.319814] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.319814] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6d3a5ad0-c473-4d61-9101-9c7582c27390',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.333173] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5c58baef-aefa-4971-bade-2a331ffbeef4 [ 925.333683] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.333961] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.334123] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.334450] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.334640] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.334860] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5c58baef-aefa-4971-bade-2a331ffbeef4 already deleted. [ 925.335068] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5c58baef-aefa-4971-bade-2a331ffbeef4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.458518] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 in Status: SUCCESS [ 925.461034] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.461034] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.461034] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.461034] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.461034] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.461034] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.461034] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.461034] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.461034] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.461034] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.461034] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.461034] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.461034] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.461911] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.462201] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.462357] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.462586] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.462910] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.463114] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.463294] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.464352] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.464633] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.464958] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.466037] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.466037] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.466037] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.466037] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.466037] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.821077] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6d3a5ad0-c473-4d61-9101-9c7582c27390: rpc.has_security_group_logging(os_id): False [ 925.842613] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.842815] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.842893] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.843130] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.843230] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.843440] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.843576] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.843631] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.843760] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.843832] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.844017] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.844130] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.844189] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.844334] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.844411] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.844625] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.844805] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.844805] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.844924] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.845067] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.845230] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 is going to be created. [ 925.914850] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.915330] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.915330] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.915503] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.915707] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.930372] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 in Status: IN_PROGRESS for 2s [ 925.971425] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761: rpc.has_security_group_logging(os_id): False [ 925.972763] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.009869] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.010109] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.010109] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.010318] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.010402] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.010683] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.010773] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.010812] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.011403] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.011403] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.011403] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.011540] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.011540] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.011630] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.011679] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.011855] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.011945] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.012014] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.014666] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.014755] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.014926] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 is going to be created. [ 926.106414] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.106880] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.106880] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.107733] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.107733] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.122352] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 in Status: IN_PROGRESS for 2s [ 926.126485] env[70614]: INFO networking_nsxv3.common.synchronization [None req-bb8ebf66-ca83-4367-b7a5-e312ae46d630 tempest-ServerActionsTestJSON-366333930 tempest-ServerActionsTestJSON-366333930-project-member] Enqueued Resource ID: def9aa42-470d-498e-9034-6879fb1e6ebc with Priority: HIGHEST for action security_group_rules [ 926.127157] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: def9aa42-470d-498e-9034-6879fb1e6ebc with Priority: HIGHEST for action security_group_rules [ 926.127813] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-def9aa42-470d-498e-9034-6879fb1e6ebc taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.127813] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.127813] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.128125] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.131090] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('def9aa42-470d-498e-9034-6879fb1e6ebc',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.291810] env[70614]: INFO networking_nsxv3.common.synchronization [None req-0c35c69f-12a7-4cea-9a27-47fa28eb2578 tempest-ServerActionsTestJSON-366333930 tempest-ServerActionsTestJSON-366333930-project-member] Enqueued Resource ID: def9aa42-470d-498e-9034-6879fb1e6ebc with Priority: HIGHEST for action security_group_rules [ 926.295012] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: def9aa42-470d-498e-9034-6879fb1e6ebc with Priority: HIGHEST for action security_group_rules [ 926.295307] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-def9aa42-470d-498e-9034-6879fb1e6ebc taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.295412] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.477046] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.658492] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.658659] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.658946] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.659230] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.659421] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.659569] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: def9aa42-470d-498e-9034-6879fb1e6ebc already deleted. [ 926.659569] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.659896] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.659996] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.660105] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('def9aa42-470d-498e-9034-6879fb1e6ebc',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.981155] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.981497] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.981647] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.981920] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.982062] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.982209] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 is going to be updated. [ 927.025023] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.025023] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.025023] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.025023] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.025023] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.041266] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 in Status: IN_PROGRESS for 2s [ 927.197845] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.198021] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.198097] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.198327] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.198397] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.198498] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: def9aa42-470d-498e-9034-6879fb1e6ebc already deleted. [ 927.198579] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.445249] env[70614]: INFO networking_nsxv3.common.synchronization [None req-b6a42493-2f8e-4f67-9db4-80fc0589636b tempest-AttachInterfacesTestJSON-1919943007 tempest-AttachInterfacesTestJSON-1919943007-project-member] Enqueued Resource ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 with Priority: HIGHEST for action security_group_members [ 927.446347] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 with Priority: HIGHEST for action security_group_members [ 927.446347] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d3a5ad0-c473-4d61-9101-9c7582c27390 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.446347] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.446347] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.446604] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.446730] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.446801] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.446856] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.447179] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.447312] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.447423] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d3a5ad0-c473-4d61-9101-9c7582c27390',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.486741] env[70614]: INFO networking_nsxv3.common.synchronization [req-727ebf7a-37cf-4c30-b8f0-f42c562c1653 req-f376617c-aeef-4cd1-a996-8435d96fcb73 tempest-AttachVolumeTestJSON-892346173 tempest-AttachVolumeTestJSON-892346173-project-member] Enqueued Resource ID: a9ca3845-322a-44b9-bb41-74f7ea3d04f7 with Priority: HIGHEST for action security_group_members [ 927.487478] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9ca3845-322a-44b9-bb41-74f7ea3d04f7 with Priority: HIGHEST for action security_group_members [ 927.487787] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9ca3845-322a-44b9-bb41-74f7ea3d04f7 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.488023] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9ca3845-322a-44b9-bb41-74f7ea3d04f7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.488023] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9ca3845-322a-44b9-bb41-74f7ea3d04f7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.488648] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9ca3845-322a-44b9-bb41-74f7ea3d04f7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.489213] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.489345] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.489938] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.489938] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.489938] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.490096] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9ca3845-322a-44b9-bb41-74f7ea3d04f7',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.609307] env[70614]: INFO networking_nsxv3.common.synchronization [None req-156960d4-4d3c-4aaf-8307-b2eecc9ce23b None None] Enqueued Resource ID: a1199002-a36c-4a52-899d-f1addf8086df with Priority: HIGHEST for action port [ 927.609410] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1199002-a36c-4a52-899d-f1addf8086df with Priority: HIGHEST for action port [ 927.612889] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-a1199002-a36c-4a52-899d-f1addf8086df taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.612889] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a1199002-a36c-4a52-899d-f1addf8086df" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.612889] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a1199002-a36c-4a52-899d-f1addf8086df" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.612889] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a1199002-a36c-4a52-899d-f1addf8086df" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.612889] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1199002-a36c-4a52-899d-f1addf8086df',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.666903] env[70614]: INFO networking_nsxv3.common.synchronization [None req-73f2ab2e-0d11-433b-a5a0-29bce10e62b3 None None] Enqueued Resource ID: 39a47e7d-6ea1-4da6-b70d-baaf716b7b05 with Priority: HIGHEST for action port [ 927.667764] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39a47e7d-6ea1-4da6-b70d-baaf716b7b05 with Priority: HIGHEST for action port [ 927.668147] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-39a47e7d-6ea1-4da6-b70d-baaf716b7b05 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.671690] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-39a47e7d-6ea1-4da6-b70d-baaf716b7b05" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.671690] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-39a47e7d-6ea1-4da6-b70d-baaf716b7b05" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.671922] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-39a47e7d-6ea1-4da6-b70d-baaf716b7b05" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.672015] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39a47e7d-6ea1-4da6-b70d-baaf716b7b05',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.946641] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 in Status: SUCCESS [ 927.946757] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.950574] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d3a5ad0-c473-4d61-9101-9c7582c27390',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.992741] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.993075] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.993075] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.993198] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.993283] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.993477] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.993575] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.993635] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.993777] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.993850] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.993934] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9ca3845-322a-44b9-bb41-74f7ea3d04f7 already deleted. [ 927.994157] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9ca3845-322a-44b9-bb41-74f7ea3d04f7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.115980] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a1199002-a36c-4a52-899d-f1addf8086df [ 928.115980] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.115980] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.115980] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.115980] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.115980] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.115980] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a1199002-a36c-4a52-899d-f1addf8086df already deleted. [ 928.115980] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a1199002-a36c-4a52-899d-f1addf8086df" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.141828] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 in Status: SUCCESS [ 928.142169] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.142404] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.142669] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.142758] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.175117] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 39a47e7d-6ea1-4da6-b70d-baaf716b7b05 [ 928.175117] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.175117] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.175117] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.175348] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.175396] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.175456] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:39a47e7d-6ea1-4da6-b70d-baaf716b7b05 already deleted. [ 928.175543] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-39a47e7d-6ea1-4da6-b70d-baaf716b7b05" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.261236] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-168 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.261236] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-168" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.261236] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-168" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.262576] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-168" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.264608] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.264995] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.267795] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.267795] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.267795] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.267795] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 928.267795] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 928.267795] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 928.267795] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 928.267795] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 928.267795] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 928.267795] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 928.291521] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 928.291740] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 928.291817] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 928.292040] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-168" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.292345] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-a2704bdf-caf4-41a9-b321-417dfecc04e8 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.293579] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-a2704bdf-caf4-41a9-b321-417dfecc04e8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.293579] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-a2704bdf-caf4-41a9-b321-417dfecc04e8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.293579] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-a2704bdf-caf4-41a9-b321-417dfecc04e8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.297335] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2704bdf-caf4-41a9-b321-417dfecc04e8',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.454576] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d3a5ad0-c473-4d61-9101-9c7582c27390',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.645972] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.645972] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.805553] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.805873] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.806046] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.806373] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.806530] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.806904] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port a2704bdf-caf4-41a9-b321-417dfecc04e8 not found, creating... [ 928.807069] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.807304] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.807471] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.808113] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.808113] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.808305] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.808878] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.808878] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.808878] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.809150] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.809212] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: a2704bdf-caf4-41a9-b321-417dfecc04e8 is going to be created. [ 928.833981] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.834281] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.834423] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.834767] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.835037] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.835343] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-a2704bdf-caf4-41a9-b321-417dfecc04e8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.957816] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.958025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.958101] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.958429] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.958525] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.958631] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 is going to be updated. [ 929.012796] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.013205] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.013205] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.013981] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.013981] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.024938] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 in Status: IN_PROGRESS for 2s [ 929.054134] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 in Status: SUCCESS [ 929.054420] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.054550] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.054765] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.054975] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.055327] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.055327] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.055399] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.055430] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.055526] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.055603] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.559517] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.559517] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.559517] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.559517] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.559517] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.559517] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.560014] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.560014] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.560014] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.560014] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.560210] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.560210] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.560210] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.560366] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.560466] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.560543] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.560603] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.560742] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.560806] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.560883] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.560975] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.635259] env[70614]: INFO networking_nsxv3.common.synchronization [req-727ebf7a-37cf-4c30-b8f0-f42c562c1653 req-db720414-66c0-47ca-b45d-72068756c0cf service nova] Enqueued Resource ID: a9ca3845-322a-44b9-bb41-74f7ea3d04f7 with Priority: HIGHEST for action security_group_rules [ 929.635259] env[70614]: INFO networking_nsxv3.common.synchronization [req-727ebf7a-37cf-4c30-b8f0-f42c562c1653 req-db720414-66c0-47ca-b45d-72068756c0cf service nova] Enqueued Resource ID: a9ca3845-322a-44b9-bb41-74f7ea3d04f7 with Priority: HIGHEST for action security_group_members [ 929.635259] env[70614]: INFO networking_nsxv3.common.synchronization [req-727ebf7a-37cf-4c30-b8f0-f42c562c1653 req-db720414-66c0-47ca-b45d-72068756c0cf service nova] Enqueued Resource ID: a2704bdf-caf4-41a9-b321-417dfecc04e8 with Priority: HIGHEST for action port [ 929.635259] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9ca3845-322a-44b9-bb41-74f7ea3d04f7 with Priority: HIGHEST for action security_group_rules [ 929.635259] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9ca3845-322a-44b9-bb41-74f7ea3d04f7 with Priority: HIGHEST for action security_group_members [ 929.635259] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2704bdf-caf4-41a9-b321-417dfecc04e8 with Priority: HIGHEST for action port [ 929.636294] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9ca3845-322a-44b9-bb41-74f7ea3d04f7 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.639331] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9ca3845-322a-44b9-bb41-74f7ea3d04f7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.639331] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9ca3845-322a-44b9-bb41-74f7ea3d04f7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.639331] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9ca3845-322a-44b9-bb41-74f7ea3d04f7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.639331] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9ca3845-322a-44b9-bb41-74f7ea3d04f7',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.641542] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9ca3845-322a-44b9-bb41-74f7ea3d04f7 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.643168] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9ca3845-322a-44b9-bb41-74f7ea3d04f7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.643168] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9ca3845-322a-44b9-bb41-74f7ea3d04f7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.643168] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9ca3845-322a-44b9-bb41-74f7ea3d04f7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.643168] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.643168] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.643168] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.643168] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.643168] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.643168] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9ca3845-322a-44b9-bb41-74f7ea3d04f7',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.644038] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-a2704bdf-caf4-41a9-b321-417dfecc04e8 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.644602] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a2704bdf-caf4-41a9-b321-417dfecc04e8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.644602] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a2704bdf-caf4-41a9-b321-417dfecc04e8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.644602] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a2704bdf-caf4-41a9-b321-417dfecc04e8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.644730] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2704bdf-caf4-41a9-b321-417dfecc04e8',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.019009] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-385 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.019330] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-385" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.019330] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-385" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.019554] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-385" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.019809] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.019974] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.020108] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.020327] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.020542] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.020777] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 930.020892] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 930.021018] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 930.021165] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 930.021309] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 930.021438] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 930.021592] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 930.042428] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 930.042595] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 930.042797] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 930.043056] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-385" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.043420] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-7c2c6ef1-4ec3-463a-a2d3-2c7373db8447 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.043628] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-7c2c6ef1-4ec3-463a-a2d3-2c7373db8447" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.043788] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-7c2c6ef1-4ec3-463a-a2d3-2c7373db8447" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.044159] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-7c2c6ef1-4ec3-463a-a2d3-2c7373db8447" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.044331] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c2c6ef1-4ec3-463a-a2d3-2c7373db8447',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.065255] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761: rpc.has_security_group_logging(os_id): False [ 930.096020] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.096230] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.096309] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.096882] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.096882] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.096994] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.097231] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.097231] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.097462] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.097580] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.097963] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.098128] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.098215] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.098379] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.098460] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.098692] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.098789] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.098856] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.099011] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.099093] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.099190] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 is going to be updated. [ 930.147255] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a9ca3845-322a-44b9-bb41-74f7ea3d04f7',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.148476] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9ca3845-322a-44b9-bb41-74f7ea3d04f7 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.148602] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9ca3845-322a-44b9-bb41-74f7ea3d04f7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.150020] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a2704bdf-caf4-41a9-b321-417dfecc04e8 with status ACTIVE [ 930.150020] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.150020] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.150020] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.150020] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.150020] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.150020] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.150020] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.150422] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.150422] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.150422] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.150513] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.150573] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.150623] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.150774] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.150843] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.151035] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a2704bdf-caf4-41a9-b321-417dfecc04e8 is going to be updated. [ 930.176054] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.176054] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.176054] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.176054] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.176054] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.178945] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.179138] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.179195] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.179411] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.179987] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.180225] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a2704bdf-caf4-41a9-b321-417dfecc04e8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.186575] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 in Status: IN_PROGRESS for 2s [ 930.541197] env[70614]: INFO networking_nsxv3.common.synchronization [None req-c8cf83b7-8287-4366-9134-b43ac6854eb9 None None] Enqueued Resource ID: c2725fdb-6907-4ce0-a747-0536668be651 with Priority: HIGHEST for action port [ 930.541393] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2725fdb-6907-4ce0-a747-0536668be651 with Priority: HIGHEST for action port [ 930.541982] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-c2725fdb-6907-4ce0-a747-0536668be651 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.542109] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c2725fdb-6907-4ce0-a747-0536668be651" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.542172] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c2725fdb-6907-4ce0-a747-0536668be651" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.542426] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c2725fdb-6907-4ce0-a747-0536668be651" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.542511] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2725fdb-6907-4ce0-a747-0536668be651',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.546411] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.546644] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.546811] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.551135] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.551135] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.551135] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 7c2c6ef1-4ec3-463a-a2d3-2c7373db8447 not found, creating... [ 930.551135] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.551135] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.551135] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.551135] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.551135] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.551135] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.551135] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.551504] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.551504] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.551566] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.551705] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 7c2c6ef1-4ec3-463a-a2d3-2c7373db8447 is going to be created. [ 930.574080] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.574305] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.574438] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.576785] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.576785] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.576785] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-7c2c6ef1-4ec3-463a-a2d3-2c7373db8447" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.653765] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a9ca3845-322a-44b9-bb41-74f7ea3d04f7',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.758894] env[70614]: INFO networking_nsxv3.common.synchronization [req-843f3557-8569-47ae-9eb4-10f74ba0dd54 req-02c4606b-5209-4ab0-b95f-99eb93dd32f8 tempest-ImagesTestJSON-1765947257 tempest-ImagesTestJSON-1765947257-project-member] Enqueued Resource ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 with Priority: HIGHEST for action security_group_members [ 930.759571] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 with Priority: HIGHEST for action security_group_members [ 930.759571] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-04a082fe-52f7-4ac6-a12b-63791c63be86 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.761600] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.761725] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.762025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.762235] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.762372] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.762461] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.762666] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.762788] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.762914] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04a082fe-52f7-4ac6-a12b-63791c63be86',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.036606] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 in Status: SUCCESS [ 931.036892] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.048082] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c2725fdb-6907-4ce0-a747-0536668be651 [ 931.048082] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.048082] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.048082] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.048082] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.048082] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.048082] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c2725fdb-6907-4ce0-a747-0536668be651 already deleted. [ 931.048082] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c2725fdb-6907-4ce0-a747-0536668be651" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.116013] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-12 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.116243] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-12" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.116373] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-12" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.116678] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-12" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.117847] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.117847] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.117847] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.117996] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.118100] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.118270] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 931.118389] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 931.118495] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 931.118601] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 931.118742] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 931.118846] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 931.118979] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 931.142647] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 931.142837] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 931.143311] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 931.143430] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-12" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.143767] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-943ab27a-8d4a-4849-93a8-02fefd888e2b taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.144031] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-943ab27a-8d4a-4849-93a8-02fefd888e2b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.144121] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-943ab27a-8d4a-4849-93a8-02fefd888e2b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.144661] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-943ab27a-8d4a-4849-93a8-02fefd888e2b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.144800] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('943ab27a-8d4a-4849-93a8-02fefd888e2b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.156371] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.156541] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.156798] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.156875] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.156968] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.157219] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9ca3845-322a-44b9-bb41-74f7ea3d04f7 is going to be created. [ 931.183261] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.183461] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.183461] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.183672] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.183915] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.200448] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9ca3845-322a-44b9-bb41-74f7ea3d04f7 in Status: UNINITIALIZED for 2s [ 931.269338] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.269538] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.270723] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.270723] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.270723] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.270723] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.270723] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.270723] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.270723] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.270723] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.270723] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 is going to be updated. [ 931.296743] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.296919] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.296958] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.297265] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.297414] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.306482] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 in Status: IN_PROGRESS for 2s [ 931.317546] env[70614]: INFO networking_nsxv3.common.synchronization [req-da757514-621c-4c1e-af66-c8ffdf422aa5 req-e33e443d-e9d8-4e0a-b2d5-62c7647a0749 service nova] Enqueued Resource ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 with Priority: HIGHEST for action security_group_rules [ 931.317740] env[70614]: INFO networking_nsxv3.common.synchronization [req-da757514-621c-4c1e-af66-c8ffdf422aa5 req-e33e443d-e9d8-4e0a-b2d5-62c7647a0749 service nova] Enqueued Resource ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 with Priority: HIGHEST for action security_group_members [ 931.317892] env[70614]: INFO networking_nsxv3.common.synchronization [req-da757514-621c-4c1e-af66-c8ffdf422aa5 req-e33e443d-e9d8-4e0a-b2d5-62c7647a0749 service nova] Enqueued Resource ID: 7c2c6ef1-4ec3-463a-a2d3-2c7373db8447 with Priority: HIGHEST for action port [ 931.318196] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 with Priority: HIGHEST for action security_group_rules [ 931.318330] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 with Priority: HIGHEST for action security_group_members [ 931.318484] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c2c6ef1-4ec3-463a-a2d3-2c7373db8447 with Priority: HIGHEST for action port [ 931.319111] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d3a5ad0-c473-4d61-9101-9c7582c27390 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.320093] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.320093] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.320093] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.320093] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d3a5ad0-c473-4d61-9101-9c7582c27390',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.321027] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d3a5ad0-c473-4d61-9101-9c7582c27390 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.321027] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.321139] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.323074] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.323074] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.323074] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.323074] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.323074] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.323074] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.323074] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d3a5ad0-c473-4d61-9101-9c7582c27390',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.323750] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c2c6ef1-4ec3-463a-a2d3-2c7373db8447 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.324116] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c2c6ef1-4ec3-463a-a2d3-2c7373db8447" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.324116] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c2c6ef1-4ec3-463a-a2d3-2c7373db8447" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.324116] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c2c6ef1-4ec3-463a-a2d3-2c7373db8447" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.324293] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c2c6ef1-4ec3-463a-a2d3-2c7373db8447',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.647724] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.647980] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.648096] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.648381] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.648533] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.648789] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 943ab27a-8d4a-4849-93a8-02fefd888e2b not found, creating... [ 931.649093] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.649261] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.649383] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.649614] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.649782] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.650107] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.650325] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.650398] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.650585] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.650722] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.650864] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 943ab27a-8d4a-4849-93a8-02fefd888e2b is going to be created. [ 931.671672] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.671918] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.671994] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.672314] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.672529] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.672775] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-943ab27a-8d4a-4849-93a8-02fefd888e2b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.824053] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d3a5ad0-c473-4d61-9101-9c7582c27390',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.825835] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d3a5ad0-c473-4d61-9101-9c7582c27390 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.825921] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.826217] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7c2c6ef1-4ec3-463a-a2d3-2c7373db8447 with status ACTIVE [ 931.826217] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.826511] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.826511] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.826657] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.826750] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.826930] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.827030] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.827091] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.827506] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.827506] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.827506] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.827641] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.827641] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.827733] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.827802] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.827888] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7c2c6ef1-4ec3-463a-a2d3-2c7373db8447 is going to be updated. [ 931.859066] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.859181] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.859881] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.859881] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.859881] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.859881] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c2c6ef1-4ec3-463a-a2d3-2c7373db8447" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.207691] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 in Status: SUCCESS [ 932.208025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.208115] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.208332] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.208421] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.327290] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d3a5ad0-c473-4d61-9101-9c7582c27390',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.380546] env[70614]: INFO networking_nsxv3.common.synchronization [req-843f3557-8569-47ae-9eb4-10f74ba0dd54 req-31b2b58d-48c4-4888-b16b-08eedf42fbe5 service nova] Enqueued Resource ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 with Priority: HIGHEST for action security_group_rules [ 932.380784] env[70614]: INFO networking_nsxv3.common.synchronization [req-843f3557-8569-47ae-9eb4-10f74ba0dd54 req-31b2b58d-48c4-4888-b16b-08eedf42fbe5 service nova] Enqueued Resource ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 with Priority: HIGHEST for action security_group_members [ 932.380890] env[70614]: INFO networking_nsxv3.common.synchronization [req-843f3557-8569-47ae-9eb4-10f74ba0dd54 req-31b2b58d-48c4-4888-b16b-08eedf42fbe5 service nova] Enqueued Resource ID: 943ab27a-8d4a-4849-93a8-02fefd888e2b with Priority: HIGHEST for action port [ 932.381142] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 with Priority: HIGHEST for action security_group_rules [ 932.381275] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 with Priority: HIGHEST for action security_group_members [ 932.381364] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 943ab27a-8d4a-4849-93a8-02fefd888e2b with Priority: HIGHEST for action port [ 932.381975] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-04a082fe-52f7-4ac6-a12b-63791c63be86 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.382127] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.382204] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.382411] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.382497] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('04a082fe-52f7-4ac6-a12b-63791c63be86',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.383396] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-04a082fe-52f7-4ac6-a12b-63791c63be86 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.383501] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.383698] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-943ab27a-8d4a-4849-93a8-02fefd888e2b taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.383804] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-943ab27a-8d4a-4849-93a8-02fefd888e2b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.383868] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-943ab27a-8d4a-4849-93a8-02fefd888e2b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.384051] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-943ab27a-8d4a-4849-93a8-02fefd888e2b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.384126] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('943ab27a-8d4a-4849-93a8-02fefd888e2b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.710594] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.710782] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.710842] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.711034] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.711201] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.711302] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.711365] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.711509] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.711597] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.711685] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.711778] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.831028] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.832149] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.832922] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.832922] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.832922] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.832922] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 is going to be updated. [ 932.887630] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-04a082fe-52f7-4ac6-a12b-63791c63be86 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.887804] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.888031] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 943ab27a-8d4a-4849-93a8-02fefd888e2b with status ACTIVE [ 932.888229] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.888342] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.888410] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.888642] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.888805] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.888984] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.889075] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.889138] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.889292] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.889373] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.889550] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.889656] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.889717] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.890247] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.890247] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.890247] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 943ab27a-8d4a-4849-93a8-02fefd888e2b is going to be updated. [ 932.937122] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.937122] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.937122] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.937122] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.937122] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.937388] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-943ab27a-8d4a-4849-93a8-02fefd888e2b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.943822] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.944023] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.944129] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.944380] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.944565] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.955625] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 in Status: IN_PROGRESS for 2s [ 933.211572] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9ca3845-322a-44b9-bb41-74f7ea3d04f7 in Status: SUCCESS [ 933.211834] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9ca3845-322a-44b9-bb41-74f7ea3d04f7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.211954] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9ca3845-322a-44b9-bb41-74f7ea3d04f7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.212292] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9ca3845-322a-44b9-bb41-74f7ea3d04f7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.212512] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.212642] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.212708] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.212898] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.212988] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.213114] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9ca3845-322a-44b9-bb41-74f7ea3d04f7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.213180] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a9ca3845-322a-44b9-bb41-74f7ea3d04f7',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.217698] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.217829] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.217897] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.218093] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.218258] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.218376] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.218439] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.218583] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.218664] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.218838] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.218986] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.219095] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.219156] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.219292] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.219426] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.219514] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.219573] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.219723] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.219811] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.219927] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.220095] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.318249] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 in Status: SUCCESS [ 933.318249] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 deletion is rescheduled due to dependency. [ 933.318459] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.318547] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.319017] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.319261] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.319444] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.319957] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.319957] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.319957] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.319957] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04a082fe-52f7-4ac6-a12b-63791c63be86',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.718744] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a9ca3845-322a-44b9-bb41-74f7ea3d04f7',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.721959] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761: rpc.has_security_group_logging(os_id): False [ 933.741500] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.741686] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.741734] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.741953] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.742075] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.742283] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.742395] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.742462] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.742613] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.742689] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.742884] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.742978] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.743046] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.743205] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.743332] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.743476] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.743563] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.743593] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.743730] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.743808] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.743893] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 is going to be updated. [ 933.807379] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.807548] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.807637] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.807883] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.808079] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.822128] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 in Status: IN_PROGRESS for 2s [ 933.823086] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('04a082fe-52f7-4ac6-a12b-63791c63be86',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.221446] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a9ca3845-322a-44b9-bb41-74f7ea3d04f7: rpc.has_security_group_logging(os_id): False [ 934.240060] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.240218] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.240289] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.240559] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.240602] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.240906] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.241070] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.241136] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.241302] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.241375] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.241468] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9ca3845-322a-44b9-bb41-74f7ea3d04f7 is going to be created. [ 934.316295] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.316555] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.316555] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.316768] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.316952] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.324851] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('04a082fe-52f7-4ac6-a12b-63791c63be86',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.328600] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9ca3845-322a-44b9-bb41-74f7ea3d04f7 in Status: IN_PROGRESS for 2s [ 934.827247] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.827396] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.829079] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.829079] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.829079] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.829079] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 is going to be updated. [ 934.860708] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.860708] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.860708] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.861151] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.861151] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.870280] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 in Status: IN_PROGRESS for 2s [ 934.968585] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 in Status: SUCCESS [ 934.968585] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.968585] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.968585] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.968585] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.968585] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.969016] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.969161] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.969295] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.969399] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.969516] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6d3a5ad0-c473-4d61-9101-9c7582c27390',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.472490] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d3a5ad0-c473-4d61-9101-9c7582c27390 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.472490] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.472490] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.472913] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.472913] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.472913] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.472913] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.473111] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.473201] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.473293] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.473439] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d3a5ad0-c473-4d61-9101-9c7582c27390 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.473550] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.473646] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.473811] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.473951] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.474061] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.474114] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.474251] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.475061] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.475061] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.475061] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6d3a5ad0-c473-4d61-9101-9c7582c27390',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.838787] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 in Status: SUCCESS [ 935.839074] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.977059] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6d3a5ad0-c473-4d61-9101-9c7582c27390: rpc.has_security_group_logging(os_id): False [ 935.995985] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.996180] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.996218] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.996444] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.996536] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.996781] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.996891] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.996985] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.997130] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.997209] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.997409] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.997483] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.997528] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.997663] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.997735] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.997944] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.998054] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.998133] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.998273] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.998347] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.998444] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 is going to be updated. [ 936.061364] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.061534] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.061579] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.061786] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.061933] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.077075] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 in Status: IN_PROGRESS for 2s [ 936.341413] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9ca3845-322a-44b9-bb41-74f7ea3d04f7 in Status: SUCCESS [ 936.341650] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9ca3845-322a-44b9-bb41-74f7ea3d04f7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.740224] env[70614]: INFO networking_nsxv3.common.synchronization [req-df1bd834-3fa2-4246-940e-ad76cf3fa2f8 req-695e5a05-1d0d-4817-9934-51c9d6853529 tempest-ServersTestMultiNic-1290380047 tempest-ServersTestMultiNic-1290380047-project-member] Enqueued Resource ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 with Priority: HIGHEST for action security_group_members [ 936.740749] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 with Priority: HIGHEST for action security_group_members [ 936.744411] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.744411] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.744411] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.744411] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.744411] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.744411] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.744411] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.744411] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.744411] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.744411] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.881664] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 in Status: SUCCESS [ 936.883068] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.883068] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.883068] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.883068] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.883068] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.883068] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.883487] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.883487] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.883487] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.883487] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('04a082fe-52f7-4ac6-a12b-63791c63be86',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.045693] env[70614]: INFO networking_nsxv3.common.synchronization [req-df1bd834-3fa2-4246-940e-ad76cf3fa2f8 req-cf5d8616-008c-4419-b66d-7003c22d0460 tempest-ServersTestMultiNic-1290380047 tempest-ServersTestMultiNic-1290380047-project-member] Enqueued Resource ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 with Priority: HIGHEST for action security_group_members [ 937.048101] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 with Priority: HIGHEST for action security_group_members [ 937.048101] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.048101] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.245536] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.386191] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-04a082fe-52f7-4ac6-a12b-63791c63be86 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.386468] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.386468] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.386651] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.386821] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.386927] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.387013] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.387225] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.387327] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.387417] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.387567] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-04a082fe-52f7-4ac6-a12b-63791c63be86 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.387660] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.387715] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.387859] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.387996] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.388105] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.388154] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.388830] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.388830] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.388830] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.388830] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('04a082fe-52f7-4ac6-a12b-63791c63be86',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.751567] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.893578] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 04a082fe-52f7-4ac6-a12b-63791c63be86: rpc.has_security_group_logging(os_id): False [ 937.912275] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.912406] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.913199] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.913516] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.913660] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.914052] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.917841] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.917841] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.918030] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.918222] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.918388] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.918516] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.918548] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.918710] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.921826] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.921826] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.921826] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.921826] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.921826] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.921826] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.921826] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 is going to be updated. [ 937.926632] env[70614]: INFO networking_nsxv3.common.synchronization [req-df1bd834-3fa2-4246-940e-ad76cf3fa2f8 req-5bdbdc18-9ca4-44cc-ab38-00d078d47d71 tempest-ServersTestMultiNic-1290380047 tempest-ServersTestMultiNic-1290380047-project-member] Enqueued Resource ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 with Priority: HIGHEST for action security_group_members [ 937.927246] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 with Priority: HIGHEST for action security_group_members [ 937.927552] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.927650] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.992620] env[70614]: INFO networking_nsxv3.common.synchronization [req-09cae2a2-39ca-4392-be49-c0a7feb3b3ff req-748853d2-6011-44fb-b9ab-9ab5cde2ee9f tempest-ServersNegativeTestJSON-1078216700 tempest-ServersNegativeTestJSON-1078216700-project-member] Enqueued Resource ID: 4be97761-0b55-45fd-ba63-8ef18d95b9f2 with Priority: HIGHEST for action security_group_members [ 937.993568] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4be97761-0b55-45fd-ba63-8ef18d95b9f2 with Priority: HIGHEST for action security_group_members [ 937.993943] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-4be97761-0b55-45fd-ba63-8ef18d95b9f2 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.994239] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.994239] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.994873] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.994992] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.995105] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.995239] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.995429] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.995530] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.995630] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4be97761-0b55-45fd-ba63-8ef18d95b9f2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.009657] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.009844] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.009944] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.010172] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.010790] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.026331] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 in Status: IN_PROGRESS for 2s [ 938.097550] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 in Status: SUCCESS [ 938.097782] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.254416] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.254652] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.254652] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.254848] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.254932] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.255037] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 is going to be updated. [ 938.289900] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.290054] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.290139] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.290378] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.290529] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.302876] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 in Status: IN_PROGRESS for 2s [ 938.498825] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.498825] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.499012] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.499145] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.499317] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.499593] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.499593] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.499714] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.500269] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.500269] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.500269] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4be97761-0b55-45fd-ba63-8ef18d95b9f2 already deleted. [ 938.500269] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.740388] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-20 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.740579] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-20" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.740706] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-20" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.741081] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-20" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.741349] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.741495] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.741995] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.742255] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.742462] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.742613] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 938.742730] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 938.742968] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 938.743171] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 938.743391] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 938.743391] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 938.743660] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 938.764702] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 938.765149] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 938.765149] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 938.765353] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-20" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.765810] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-e52d6b2b-cbee-42fc-bf72-9bdec59dae74 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.766069] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-e52d6b2b-cbee-42fc-bf72-9bdec59dae74" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.766225] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-e52d6b2b-cbee-42fc-bf72-9bdec59dae74" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.766593] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-e52d6b2b-cbee-42fc-bf72-9bdec59dae74" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.766756] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e52d6b2b-cbee-42fc-bf72-9bdec59dae74',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.273118] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.273118] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.273118] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.273118] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.273118] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.273118] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port e52d6b2b-cbee-42fc-bf72-9bdec59dae74 not found, creating... [ 939.273118] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.273118] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.273405] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.273433] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.273604] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.273835] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.273989] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.274128] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.274341] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.274477] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.274619] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: e52d6b2b-cbee-42fc-bf72-9bdec59dae74 is going to be created. [ 939.297260] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.297260] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.297552] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.297654] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.297888] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.298134] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-e52d6b2b-cbee-42fc-bf72-9bdec59dae74" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.043107] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 in Status: SUCCESS [ 940.043458] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.259200] env[70614]: INFO networking_nsxv3.common.synchronization [req-09cae2a2-39ca-4392-be49-c0a7feb3b3ff req-68bc4f2a-9c58-4498-b06c-c398e53dfc00 service nova] Enqueued Resource ID: 4be97761-0b55-45fd-ba63-8ef18d95b9f2 with Priority: HIGHEST for action security_group_rules [ 940.259200] env[70614]: INFO networking_nsxv3.common.synchronization [req-09cae2a2-39ca-4392-be49-c0a7feb3b3ff req-68bc4f2a-9c58-4498-b06c-c398e53dfc00 service nova] Enqueued Resource ID: 4be97761-0b55-45fd-ba63-8ef18d95b9f2 with Priority: HIGHEST for action security_group_members [ 940.259200] env[70614]: INFO networking_nsxv3.common.synchronization [req-09cae2a2-39ca-4392-be49-c0a7feb3b3ff req-68bc4f2a-9c58-4498-b06c-c398e53dfc00 service nova] Enqueued Resource ID: e52d6b2b-cbee-42fc-bf72-9bdec59dae74 with Priority: HIGHEST for action port [ 940.259200] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4be97761-0b55-45fd-ba63-8ef18d95b9f2 with Priority: HIGHEST for action security_group_rules [ 940.263484] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4be97761-0b55-45fd-ba63-8ef18d95b9f2 with Priority: HIGHEST for action security_group_members [ 940.263484] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e52d6b2b-cbee-42fc-bf72-9bdec59dae74 with Priority: HIGHEST for action port [ 940.263484] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4be97761-0b55-45fd-ba63-8ef18d95b9f2 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.263484] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.263484] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.263484] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.263484] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4be97761-0b55-45fd-ba63-8ef18d95b9f2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.263484] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-4be97761-0b55-45fd-ba63-8ef18d95b9f2 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.264706] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.265066] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.265918] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.266149] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.266518] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.266518] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.266881] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.266928] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.268024] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4be97761-0b55-45fd-ba63-8ef18d95b9f2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.270145] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-e52d6b2b-cbee-42fc-bf72-9bdec59dae74 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.270269] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e52d6b2b-cbee-42fc-bf72-9bdec59dae74" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.270315] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e52d6b2b-cbee-42fc-bf72-9bdec59dae74" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.271927] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e52d6b2b-cbee-42fc-bf72-9bdec59dae74" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.271927] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e52d6b2b-cbee-42fc-bf72-9bdec59dae74',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.275840] env[70614]: INFO networking_nsxv3.common.synchronization [req-62fc29fd-5acc-4cef-bf09-7e6ce4e10e41 req-43b704aa-7362-4452-851d-d53d451867cf tempest-ServersAdminTestJSON-365827888 tempest-ServersAdminTestJSON-365827888-project-member] Enqueued Resource ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b with Priority: HIGHEST for action security_group_members [ 940.276931] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b with Priority: HIGHEST for action security_group_members [ 940.276931] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.277054] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.278506] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.278506] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.278506] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.278506] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.278506] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.278506] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.278506] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.278506] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.313117] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 in Status: SUCCESS [ 940.313271] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.313428] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.313857] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.313857] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.313957] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.313988] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.314150] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.314223] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.314314] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.776112] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4be97761-0b55-45fd-ba63-8ef18d95b9f2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.776112] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-4be97761-0b55-45fd-ba63-8ef18d95b9f2 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.776112] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.784130] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e52d6b2b-cbee-42fc-bf72-9bdec59dae74 with status ACTIVE [ 940.784130] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.784130] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.784130] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.784130] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.784130] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.784130] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.784130] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.784130] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.784130] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.784130] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.784130] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.784130] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.784130] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.784130] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.784130] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.784130] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e52d6b2b-cbee-42fc-bf72-9bdec59dae74 is going to be updated. [ 940.786757] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.811129] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.811129] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.811129] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.811129] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.811413] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.811444] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e52d6b2b-cbee-42fc-bf72-9bdec59dae74" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.818428] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.818428] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.818428] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.818428] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.818428] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.818428] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.818428] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.818428] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.818428] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.818428] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.818428] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 is going to be updated. [ 940.852729] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.852729] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.852991] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.853225] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.853304] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.868254] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 in Status: IN_PROGRESS for 2s [ 941.282927] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4be97761-0b55-45fd-ba63-8ef18d95b9f2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.297226] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.677259] env[70614]: INFO networking_nsxv3.common.synchronization [req-e7942e2c-eff0-40f2-a2fd-111d1ba233b4 req-6dada8a5-4222-4712-b319-b1b262579efb tempest-DeleteServersTestJSON-1690139659 tempest-DeleteServersTestJSON-1690139659-project-member] Enqueued Resource ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f with Priority: HIGHEST for action security_group_members [ 941.677845] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f with Priority: HIGHEST for action security_group_members [ 941.678170] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.678297] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.678360] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.678560] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.678848] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.678848] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.678968] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.679172] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.679286] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.681177] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df8f20f5-6e92-4ac4-bdd2-05863ac4905f',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.786091] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.786277] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.787539] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.787539] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.787539] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.787539] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4be97761-0b55-45fd-ba63-8ef18d95b9f2 is going to be created. [ 941.802207] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.802310] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.802526] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.802634] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.802773] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.802847] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b is going to be updated. [ 941.819681] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.821123] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.821123] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.821123] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.821123] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.834959] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4be97761-0b55-45fd-ba63-8ef18d95b9f2 in Status: UNINITIALIZED for 2s [ 941.835957] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.836504] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.836504] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.836504] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.836941] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.848196] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b in Status: IN_PROGRESS for 2s [ 942.182630] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.182907] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.183042] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.183336] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.183459] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.183708] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.183879] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.183985] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.184252] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.184419] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.184569] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f is going to be updated. [ 942.223253] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.223500] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.223500] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.223701] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.224151] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.236139] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f in Status: IN_PROGRESS for 2s [ 942.885337] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 in Status: SUCCESS [ 942.885632] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 deletion is rescheduled due to dependency. [ 942.885632] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.885793] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.886013] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.886198] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.886318] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.886382] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.886534] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.886614] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.886710] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.388928] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.389170] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.389291] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.389538] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.389666] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.389924] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.390124] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.390187] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.390347] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.390456] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.390569] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 is going to be updated. [ 943.416919] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.417104] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.417175] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.417387] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.417530] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.427924] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 in Status: IN_PROGRESS for 2s [ 943.850427] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4be97761-0b55-45fd-ba63-8ef18d95b9f2 in Status: SUCCESS [ 943.850700] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.850845] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.851177] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.853703] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.853881] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.853974] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.854186] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.854278] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.854373] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.854471] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4be97761-0b55-45fd-ba63-8ef18d95b9f2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.858438] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b in Status: SUCCESS [ 943.858713] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.906223] env[70614]: INFO networking_nsxv3.common.synchronization [req-e2b766cf-28fe-43a7-a65d-26a710aa4588 req-9a409be8-f233-49f4-a3ad-dbd5b4f329eb tempest-ImagesOneServerNegativeTestJSON-1769697081 tempest-ImagesOneServerNegativeTestJSON-1769697081-project-member] Enqueued Resource ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e with Priority: HIGHEST for action security_group_members [ 943.906223] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e with Priority: HIGHEST for action security_group_members [ 943.906763] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-3060abf5-a0d6-4fce-88da-15f03f632b6e taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.906949] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.907047] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.907316] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.908440] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.908440] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.908440] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.908642] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.908642] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.909047] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3060abf5-a0d6-4fce-88da-15f03f632b6e',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.251058] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f in Status: SUCCESS [ 944.251058] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f deletion is rescheduled due to dependency. [ 944.251058] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.362655] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-4be97761-0b55-45fd-ba63-8ef18d95b9f2 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.362927] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.362927] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.363160] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.363333] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.363434] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.363498] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.363646] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.363733] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.363822] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.363965] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-4be97761-0b55-45fd-ba63-8ef18d95b9f2 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.364221] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.364221] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.364321] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.364392] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.364482] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.364543] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.364674] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.364750] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.364832] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.364921] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4be97761-0b55-45fd-ba63-8ef18d95b9f2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.411654] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.411803] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.411879] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.412116] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.412207] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.412405] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.412504] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.412565] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.412710] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.412788] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.412875] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e is going to be updated. [ 944.442204] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.442361] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.442433] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.442745] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.443069] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.457279] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e in Status: IN_PROGRESS for 2s [ 944.845664] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-720 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.845997] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-720" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.846229] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-720" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.847562] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-720" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.847562] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.847562] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.847883] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.847949] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.848204] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.848566] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 944.848698] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 944.848905] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 944.849105] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 944.849298] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 944.849507] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 944.850535] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 944.872149] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 944.872149] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 944.872149] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 944.872149] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-720" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.872149] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-2256e0a7-3041-47e2-9f3b-6cdc168aa012 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.872149] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-2256e0a7-3041-47e2-9f3b-6cdc168aa012" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.872149] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-2256e0a7-3041-47e2-9f3b-6cdc168aa012" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.872149] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-2256e0a7-3041-47e2-9f3b-6cdc168aa012" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.872149] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2256e0a7-3041-47e2-9f3b-6cdc168aa012',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.874414] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4be97761-0b55-45fd-ba63-8ef18d95b9f2: rpc.has_security_group_logging(os_id): False [ 944.899872] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.899872] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.899872] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.899872] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.899872] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.899872] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.901032] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.901032] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.904126] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.904126] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.904126] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.904126] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.904126] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.904126] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.904126] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.904126] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.904126] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.904126] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.904126] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.904126] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.904126] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4be97761-0b55-45fd-ba63-8ef18d95b9f2 is going to be created. [ 944.931256] env[70614]: INFO networking_nsxv3.common.synchronization [req-cfa3a6bd-3cc8-407c-a4c4-731cb37c7f20 req-5259493c-eb21-44b8-9608-808453e17312 tempest-AttachInterfacesTestJSON-1919943007 tempest-AttachInterfacesTestJSON-1919943007-project-member] Enqueued Resource ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 with Priority: HIGHEST for action security_group_members [ 944.931814] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 with Priority: HIGHEST for action security_group_members [ 944.934685] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d3a5ad0-c473-4d61-9101-9c7582c27390 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.934685] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.934685] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.934685] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.934685] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.934685] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.934685] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.934685] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.934685] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.934685] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d3a5ad0-c473-4d61-9101-9c7582c27390',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.982419] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.982419] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.982419] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.983820] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.983820] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.000613] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4be97761-0b55-45fd-ba63-8ef18d95b9f2 in Status: IN_PROGRESS for 2s [ 945.375871] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.375871] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.376078] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.376525] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.376670] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.376907] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 2256e0a7-3041-47e2-9f3b-6cdc168aa012 not found, creating... [ 945.377292] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.377487] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.377635] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.377910] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.378539] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.379468] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.379829] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.379974] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.380228] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.380387] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.380529] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 2256e0a7-3041-47e2-9f3b-6cdc168aa012 is going to be created. [ 945.401819] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.401819] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.401819] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.402237] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.402433] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.402708] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-2256e0a7-3041-47e2-9f3b-6cdc168aa012" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.438877] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d3a5ad0-c473-4d61-9101-9c7582c27390',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.447509] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 in Status: SUCCESS [ 945.447509] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 deletion is rescheduled due to dependency. [ 945.447509] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.770393] env[70614]: INFO networking_nsxv3.common.synchronization [None req-445fb204-2a2c-42e7-b8b5-95a63b1f7746 tempest-AttachInterfacesTestJSON-1919943007 tempest-AttachInterfacesTestJSON-1919943007-project-member] Enqueued Resource ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 with Priority: HIGHEST for action security_group_members [ 945.770972] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 with Priority: HIGHEST for action security_group_members [ 945.771311] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d3a5ad0-c473-4d61-9101-9c7582c27390 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.771412] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.942165] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d3a5ad0-c473-4d61-9101-9c7582c27390',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.409812] env[70614]: INFO networking_nsxv3.common.synchronization [req-6c2924fd-d94c-43a8-8842-d9e41940fcb7 req-b12bb434-d599-4850-b9d5-85363ffd90a1 tempest-ServerActionsTestJSON-366333930 tempest-ServerActionsTestJSON-366333930-project-member] Enqueued Resource ID: def9aa42-470d-498e-9034-6879fb1e6ebc with Priority: HIGHEST for action security_group_members [ 946.409812] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: def9aa42-470d-498e-9034-6879fb1e6ebc with Priority: HIGHEST for action security_group_members [ 946.410668] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-def9aa42-470d-498e-9034-6879fb1e6ebc taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.410668] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.411048] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.411048] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.411212] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.412130] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.412130] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.412130] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.412130] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.412130] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('def9aa42-470d-498e-9034-6879fb1e6ebc',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.444281] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.444493] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.446020] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.446414] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.446538] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.446625] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 is going to be updated. [ 946.468295] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e in Status: SUCCESS [ 946.468474] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e deletion is rescheduled due to dependency. [ 946.468944] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.488342] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.488521] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.488583] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.488860] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.489028] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.502482] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 in Status: IN_PROGRESS for 2s [ 946.504653] env[70614]: INFO networking_nsxv3.common.synchronization [req-e2b766cf-28fe-43a7-a65d-26a710aa4588 req-118b2a45-7ea5-4d1b-ac1c-2c7bdd06cbb7 service nova] Enqueued Resource ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e with Priority: HIGHEST for action security_group_rules [ 946.504815] env[70614]: INFO networking_nsxv3.common.synchronization [req-e2b766cf-28fe-43a7-a65d-26a710aa4588 req-118b2a45-7ea5-4d1b-ac1c-2c7bdd06cbb7 service nova] Enqueued Resource ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e with Priority: HIGHEST for action security_group_members [ 946.504986] env[70614]: INFO networking_nsxv3.common.synchronization [req-e2b766cf-28fe-43a7-a65d-26a710aa4588 req-118b2a45-7ea5-4d1b-ac1c-2c7bdd06cbb7 service nova] Enqueued Resource ID: 2256e0a7-3041-47e2-9f3b-6cdc168aa012 with Priority: HIGHEST for action port [ 946.505338] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e with Priority: HIGHEST for action security_group_rules [ 946.505338] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e with Priority: HIGHEST for action security_group_members [ 946.505490] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2256e0a7-3041-47e2-9f3b-6cdc168aa012 with Priority: HIGHEST for action port [ 946.506051] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3060abf5-a0d6-4fce-88da-15f03f632b6e taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.506258] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.506824] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.506824] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.506824] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3060abf5-a0d6-4fce-88da-15f03f632b6e',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.508741] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-3060abf5-a0d6-4fce-88da-15f03f632b6e taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.508892] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.508949] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.509126] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.510083] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.510083] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.510083] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.510083] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.510083] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.510083] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3060abf5-a0d6-4fce-88da-15f03f632b6e',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.510894] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-2256e0a7-3041-47e2-9f3b-6cdc168aa012 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.510996] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2256e0a7-3041-47e2-9f3b-6cdc168aa012" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.511187] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2256e0a7-3041-47e2-9f3b-6cdc168aa012" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.511497] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2256e0a7-3041-47e2-9f3b-6cdc168aa012" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.511497] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2256e0a7-3041-47e2-9f3b-6cdc168aa012',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.914786] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.914980] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.915078] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.915276] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.915355] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.915568] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.915713] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.915768] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.916820] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.916820] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.916820] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: def9aa42-470d-498e-9034-6879fb1e6ebc already deleted. [ 946.916820] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.969788] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-117 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.970186] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-117" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.970395] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-117" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.970863] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-117" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.971284] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.971539] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.971729] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.972097] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.972338] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.972659] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 946.972858] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 946.975315] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 946.975315] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 946.975315] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 946.975315] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 946.975315] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 946.998580] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 946.998753] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 946.998907] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 946.999133] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-117" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.999459] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-b3315488-6fff-4de5-a802-67a3180773cb taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.999640] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-b3315488-6fff-4de5-a802-67a3180773cb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.999767] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-b3315488-6fff-4de5-a802-67a3180773cb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.000188] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-b3315488-6fff-4de5-a802-67a3180773cb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.000284] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3315488-6fff-4de5-a802-67a3180773cb',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.013608] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-3060abf5-a0d6-4fce-88da-15f03f632b6e taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.013849] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.013917] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3060abf5-a0d6-4fce-88da-15f03f632b6e',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.015240] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2256e0a7-3041-47e2-9f3b-6cdc168aa012 with status ACTIVE [ 947.015691] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.015691] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.015852] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.018460] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.018460] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.018460] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.018460] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.018460] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.018460] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.018460] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.018460] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.018460] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.018460] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.018460] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.018460] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.018460] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2256e0a7-3041-47e2-9f3b-6cdc168aa012 is going to be updated. [ 947.022995] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4be97761-0b55-45fd-ba63-8ef18d95b9f2 in Status: SUCCESS [ 947.023262] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.055931] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.057070] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.057070] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.057070] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.057070] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.057070] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2256e0a7-3041-47e2-9f3b-6cdc168aa012" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.503488] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.503747] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.503876] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.504201] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.504402] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.504604] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port b3315488-6fff-4de5-a802-67a3180773cb not found, creating... [ 947.504883] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.505070] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.505195] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.505430] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.505573] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.505967] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.506165] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.506285] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.506498] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.506636] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.506782] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: b3315488-6fff-4de5-a802-67a3180773cb is going to be created. [ 947.519623] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3060abf5-a0d6-4fce-88da-15f03f632b6e',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.530072] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.530348] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.530519] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.530807] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.531150] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.531353] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-b3315488-6fff-4de5-a802-67a3180773cb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.022502] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.022782] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.022782] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.022981] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.023093] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.023198] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e is going to be updated. [ 948.058146] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.058366] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.058366] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.058816] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.058970] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.068506] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e in Status: IN_PROGRESS for 2s [ 948.435381] env[70614]: INFO networking_nsxv3.common.synchronization [req-6c2924fd-d94c-43a8-8842-d9e41940fcb7 req-ed264a9a-579e-4137-af15-b4d64189cf0e service nova] Enqueued Resource ID: def9aa42-470d-498e-9034-6879fb1e6ebc with Priority: HIGHEST for action security_group_rules [ 948.435381] env[70614]: INFO networking_nsxv3.common.synchronization [req-6c2924fd-d94c-43a8-8842-d9e41940fcb7 req-ed264a9a-579e-4137-af15-b4d64189cf0e service nova] Enqueued Resource ID: def9aa42-470d-498e-9034-6879fb1e6ebc with Priority: HIGHEST for action security_group_members [ 948.435381] env[70614]: INFO networking_nsxv3.common.synchronization [req-6c2924fd-d94c-43a8-8842-d9e41940fcb7 req-ed264a9a-579e-4137-af15-b4d64189cf0e service nova] Enqueued Resource ID: b3315488-6fff-4de5-a802-67a3180773cb with Priority: HIGHEST for action port [ 948.435381] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: def9aa42-470d-498e-9034-6879fb1e6ebc with Priority: HIGHEST for action security_group_rules [ 948.435381] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: def9aa42-470d-498e-9034-6879fb1e6ebc with Priority: HIGHEST for action security_group_members [ 948.435381] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3315488-6fff-4de5-a802-67a3180773cb with Priority: HIGHEST for action port [ 948.436347] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-def9aa42-470d-498e-9034-6879fb1e6ebc taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.436839] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.437022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.437827] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.438574] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('def9aa42-470d-498e-9034-6879fb1e6ebc',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.439744] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-def9aa42-470d-498e-9034-6879fb1e6ebc taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.439937] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.441125] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.441125] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.441125] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.441125] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.441125] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.441125] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.441125] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.441443] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('def9aa42-470d-498e-9034-6879fb1e6ebc',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.442276] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-b3315488-6fff-4de5-a802-67a3180773cb taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.442395] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b3315488-6fff-4de5-a802-67a3180773cb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.442566] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b3315488-6fff-4de5-a802-67a3180773cb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.442739] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b3315488-6fff-4de5-a802-67a3180773cb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.442827] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3315488-6fff-4de5-a802-67a3180773cb',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.510883] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 in Status: SUCCESS [ 948.511206] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.511479] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.511776] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.512338] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.512338] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.512338] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.512338] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.512546] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.512546] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d3a5ad0-c473-4d61-9101-9c7582c27390',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.757906] env[70614]: INFO networking_nsxv3.common.synchronization [req-d26a57b7-4d45-49f9-bc29-c3fad58034e4 req-d36519ef-4e2e-4249-81df-3b2203e335a7 tempest-ServerAddressesTestJSON-900382373 tempest-ServerAddressesTestJSON-900382373-project-member] Enqueued Resource ID: 3172accd-a4e8-4297-999e-158d19f8d74b with Priority: HIGHEST for action security_group_members [ 948.758509] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3172accd-a4e8-4297-999e-158d19f8d74b with Priority: HIGHEST for action security_group_members [ 948.758846] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-3172accd-a4e8-4297-999e-158d19f8d74b taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.759025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3172accd-a4e8-4297-999e-158d19f8d74b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.759359] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3172accd-a4e8-4297-999e-158d19f8d74b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.759661] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3172accd-a4e8-4297-999e-158d19f8d74b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.759838] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.759952] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.760028] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.760187] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.760300] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.760372] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3172accd-a4e8-4297-999e-158d19f8d74b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.946414] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b3315488-6fff-4de5-a802-67a3180773cb with status ACTIVE [ 948.946727] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.946949] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.947108] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.947337] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.947443] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.948404] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.948404] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.948404] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.948404] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.948404] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.948404] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.948738] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.948738] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.948876] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.948970] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.950131] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b3315488-6fff-4de5-a802-67a3180773cb is going to be updated. [ 948.953160] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('def9aa42-470d-498e-9034-6879fb1e6ebc',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.953160] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-def9aa42-470d-498e-9034-6879fb1e6ebc taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.953160] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.962234] env[70614]: INFO networking_nsxv3.common.synchronization [req-d88f7ba0-b4ec-4e44-8bd4-f2b55a6d14fe req-a1843d76-30cb-4884-b4bc-37f9f2706cfe tempest-ServersV294TestFqdnHostnames-346829035 tempest-ServersV294TestFqdnHostnames-346829035-project-member] Enqueued Resource ID: 3f4770f9-9c1b-48b7-8d14-3089a02098e4 with Priority: HIGHEST for action security_group_members [ 948.965024] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f4770f9-9c1b-48b7-8d14-3089a02098e4 with Priority: HIGHEST for action security_group_members [ 948.965024] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f4770f9-9c1b-48b7-8d14-3089a02098e4 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.965024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f4770f9-9c1b-48b7-8d14-3089a02098e4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.965024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f4770f9-9c1b-48b7-8d14-3089a02098e4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.965024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f4770f9-9c1b-48b7-8d14-3089a02098e4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.965646] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.965768] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.965834] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.966214] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.966214] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.966214] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f4770f9-9c1b-48b7-8d14-3089a02098e4',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.982150] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.982150] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.982150] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.982150] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.982150] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.982150] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b3315488-6fff-4de5-a802-67a3180773cb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.018027] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.018027] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.018027] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.018027] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.018027] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.018027] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.018027] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.018027] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.018027] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.018027] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.018027] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 is going to be updated. [ 949.078135] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.078135] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.078135] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.078135] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.078135] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.086581] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 in Status: IN_PROGRESS for 2s [ 949.262525] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.262704] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.262704] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.262830] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.262950] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.263162] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.263268] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.263337] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.264198] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.264323] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.264442] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3172accd-a4e8-4297-999e-158d19f8d74b already deleted. [ 949.264536] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3172accd-a4e8-4297-999e-158d19f8d74b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.457012] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('def9aa42-470d-498e-9034-6879fb1e6ebc',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.470465] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.470465] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.470465] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.470746] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.470746] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.470855] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.470935] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.470992] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.471234] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.471319] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.471406] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f4770f9-9c1b-48b7-8d14-3089a02098e4 is going to be updated. [ 949.505209] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.505440] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.505440] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.505651] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.505834] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.517228] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f4770f9-9c1b-48b7-8d14-3089a02098e4 in Status: IN_PROGRESS for 2s [ 949.955347] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-398 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.955640] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-398" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.955804] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-398" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.956197] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-398" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.956525] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.956860] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.957093] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.957390] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.957580] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.957828] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 949.958046] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 949.958138] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 949.958244] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 949.958390] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 949.958526] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 949.958734] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 949.960303] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.960465] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.960514] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.960712] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.960827] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.961152] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: def9aa42-470d-498e-9034-6879fb1e6ebc is going to be created. [ 949.981338] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 949.981529] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 949.981650] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 949.981840] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-398" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.982200] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-78aad52b-8b5c-4d6f-a173-4b873fbb59eb taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.982378] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-78aad52b-8b5c-4d6f-a173-4b873fbb59eb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.982609] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-78aad52b-8b5c-4d6f-a173-4b873fbb59eb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.982844] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-78aad52b-8b5c-4d6f-a173-4b873fbb59eb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.982998] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78aad52b-8b5c-4d6f-a173-4b873fbb59eb',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.990259] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.990397] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.990497] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.990671] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.990833] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.001041] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: def9aa42-470d-498e-9034-6879fb1e6ebc in Status: UNINITIALIZED for 2s [ 950.077528] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e in Status: SUCCESS [ 950.077825] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.078014] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.078230] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.079345] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.079455] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.079526] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.079699] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.079781] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.080140] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.080310] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3060abf5-a0d6-4fce-88da-15f03f632b6e',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.491326] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.491643] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.492596] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.493024] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.493202] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.493377] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 78aad52b-8b5c-4d6f-a173-4b873fbb59eb not found, creating... [ 950.494403] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.494597] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.494723] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.494980] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.495149] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.495476] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.495639] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.495765] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.495986] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.497111] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.497303] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 78aad52b-8b5c-4d6f-a173-4b873fbb59eb is going to be created. [ 950.524042] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.524042] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.524042] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.524042] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.524042] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.524042] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-78aad52b-8b5c-4d6f-a173-4b873fbb59eb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.582796] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-3060abf5-a0d6-4fce-88da-15f03f632b6e taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.583073] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.583145] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.583436] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.583545] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.583651] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.583711] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.583833] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.583919] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.584020] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.584176] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-3060abf5-a0d6-4fce-88da-15f03f632b6e taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.584253] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.584309] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.584448] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.584582] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.584679] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.584732] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.585083] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.585083] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.585083] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.585083] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3060abf5-a0d6-4fce-88da-15f03f632b6e',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.091292] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3060abf5-a0d6-4fce-88da-15f03f632b6e: rpc.has_security_group_logging(os_id): False [ 951.115754] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 in Status: SUCCESS [ 951.117583] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 deletion is rescheduled due to dependency. [ 951.118066] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.120904] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.121176] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.121287] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.121621] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.121726] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.121992] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.122119] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.122119] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.122296] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.122362] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.122579] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.122700] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.122761] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.122892] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.122972] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.123184] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.123302] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.123378] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.123597] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.123712] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.123855] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e is going to be updated. [ 951.225886] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.226154] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.226227] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.226515] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.226758] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.252864] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e in Status: IN_PROGRESS for 2s [ 951.528027] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f4770f9-9c1b-48b7-8d14-3089a02098e4 in Status: SUCCESS [ 951.528027] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f4770f9-9c1b-48b7-8d14-3089a02098e4 deletion is rescheduled due to dependency. [ 951.528027] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f4770f9-9c1b-48b7-8d14-3089a02098e4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.550045] env[70614]: INFO networking_nsxv3.common.synchronization [req-d26a57b7-4d45-49f9-bc29-c3fad58034e4 req-b59f302e-67c0-405f-8cbb-ed05425cd7b6 service nova] Enqueued Resource ID: 3172accd-a4e8-4297-999e-158d19f8d74b with Priority: HIGHEST for action security_group_rules [ 951.550045] env[70614]: INFO networking_nsxv3.common.synchronization [req-d26a57b7-4d45-49f9-bc29-c3fad58034e4 req-b59f302e-67c0-405f-8cbb-ed05425cd7b6 service nova] Enqueued Resource ID: 3172accd-a4e8-4297-999e-158d19f8d74b with Priority: HIGHEST for action security_group_members [ 951.550045] env[70614]: INFO networking_nsxv3.common.synchronization [req-d26a57b7-4d45-49f9-bc29-c3fad58034e4 req-b59f302e-67c0-405f-8cbb-ed05425cd7b6 service nova] Enqueued Resource ID: 78aad52b-8b5c-4d6f-a173-4b873fbb59eb with Priority: HIGHEST for action port [ 951.550045] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3172accd-a4e8-4297-999e-158d19f8d74b with Priority: HIGHEST for action security_group_rules [ 951.550045] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3172accd-a4e8-4297-999e-158d19f8d74b with Priority: HIGHEST for action security_group_members [ 951.550045] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78aad52b-8b5c-4d6f-a173-4b873fbb59eb with Priority: HIGHEST for action port [ 951.550045] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3172accd-a4e8-4297-999e-158d19f8d74b taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.550045] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3172accd-a4e8-4297-999e-158d19f8d74b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.550045] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3172accd-a4e8-4297-999e-158d19f8d74b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.550045] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3172accd-a4e8-4297-999e-158d19f8d74b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.552016] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3172accd-a4e8-4297-999e-158d19f8d74b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.553170] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-3172accd-a4e8-4297-999e-158d19f8d74b taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.553418] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3172accd-a4e8-4297-999e-158d19f8d74b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.553588] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3172accd-a4e8-4297-999e-158d19f8d74b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.554257] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3172accd-a4e8-4297-999e-158d19f8d74b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.554562] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.554790] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.554931] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.555177] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.555343] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.555603] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3172accd-a4e8-4297-999e-158d19f8d74b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.556555] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-78aad52b-8b5c-4d6f-a173-4b873fbb59eb taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.556879] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-78aad52b-8b5c-4d6f-a173-4b873fbb59eb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.557027] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-78aad52b-8b5c-4d6f-a173-4b873fbb59eb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.557350] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-78aad52b-8b5c-4d6f-a173-4b873fbb59eb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.557494] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78aad52b-8b5c-4d6f-a173-4b873fbb59eb',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.010972] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: def9aa42-470d-498e-9034-6879fb1e6ebc in Status: SUCCESS [ 952.011275] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.011450] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.011697] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.011961] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.012119] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.012188] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.012351] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.012433] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.012519] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.012616] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('def9aa42-470d-498e-9034-6879fb1e6ebc',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.059994] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 78aad52b-8b5c-4d6f-a173-4b873fbb59eb with status ACTIVE [ 952.060280] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.060417] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.060463] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.060679] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.060765] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.060978] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.061099] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.061162] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.061314] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.061391] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.061598] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.061667] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.061721] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.061855] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.061930] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.062020] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 78aad52b-8b5c-4d6f-a173-4b873fbb59eb is going to be updated. [ 952.063114] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3172accd-a4e8-4297-999e-158d19f8d74b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.064091] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-3172accd-a4e8-4297-999e-158d19f8d74b taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.064226] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3172accd-a4e8-4297-999e-158d19f8d74b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.087530] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.087704] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.087784] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.087971] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.088139] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.088672] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-78aad52b-8b5c-4d6f-a173-4b873fbb59eb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.514945] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('def9aa42-470d-498e-9034-6879fb1e6ebc',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.564861] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3172accd-a4e8-4297-999e-158d19f8d74b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.683814] env[70614]: INFO networking_nsxv3.common.synchronization [req-b823886a-da98-4921-a672-da8aa43038a3 req-b05f15f6-1c95-497a-a49d-ec4ba3236b10 tempest-MigrationsAdminTest-2080415140 tempest-MigrationsAdminTest-2080415140-project-member] Enqueued Resource ID: 49dd754e-129e-49c8-9e52-09796cb64337 with Priority: HIGHEST for action security_group_members [ 952.684365] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49dd754e-129e-49c8-9e52-09796cb64337 with Priority: HIGHEST for action security_group_members [ 952.685430] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-49dd754e-129e-49c8-9e52-09796cb64337 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.685430] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.685430] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.685430] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.685430] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.686278] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.686374] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.687727] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.688021] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.688465] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49dd754e-129e-49c8-9e52-09796cb64337',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.017608] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for def9aa42-470d-498e-9034-6879fb1e6ebc: rpc.has_security_group_logging(os_id): False [ 953.050315] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.050479] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.050546] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.051840] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.052201] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.052631] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.052727] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.052727] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.052939] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.053061] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.053181] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: def9aa42-470d-498e-9034-6879fb1e6ebc is going to be created. [ 953.067359] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.067577] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.067649] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.067823] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.067936] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.068184] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3172accd-a4e8-4297-999e-158d19f8d74b is going to be created. [ 953.107308] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.107308] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.107308] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.107585] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.107695] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.141238] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3172accd-a4e8-4297-999e-158d19f8d74b in Status: UNINITIALIZED for 2s [ 953.191886] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('49dd754e-129e-49c8-9e52-09796cb64337',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.203189] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.203315] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.203463] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.203600] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.203788] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.220468] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: def9aa42-470d-498e-9034-6879fb1e6ebc in Status: IN_PROGRESS for 2s [ 953.273112] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e in Status: SUCCESS [ 953.273382] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.693735] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('49dd754e-129e-49c8-9e52-09796cb64337',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.195830] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.196050] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.196100] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.196354] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.196446] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.196547] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49dd754e-129e-49c8-9e52-09796cb64337 is going to be updated. [ 954.268781] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.269129] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.269237] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.269493] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.269693] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.280516] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49dd754e-129e-49c8-9e52-09796cb64337 in Status: IN_PROGRESS for 2s [ 954.477488] env[70614]: INFO networking_nsxv3.common.synchronization [req-eb8ef698-d199-4887-bd9e-ad87646c2c8d req-95c75ece-0762-406c-ba56-80b4206cef69 tempest-AttachInterfacesTestJSON-1919943007 tempest-AttachInterfacesTestJSON-1919943007-project-member] Enqueued Resource ID: 64d5aaad-612c-45e4-8c2c-8d390ad3ffdd with Priority: HIGHEST for action security_group_members [ 954.478042] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64d5aaad-612c-45e4-8c2c-8d390ad3ffdd with Priority: HIGHEST for action security_group_members [ 954.478339] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-64d5aaad-612c-45e4-8c2c-8d390ad3ffdd taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.478482] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64d5aaad-612c-45e4-8c2c-8d390ad3ffdd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.478571] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64d5aaad-612c-45e4-8c2c-8d390ad3ffdd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.478711] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64d5aaad-612c-45e4-8c2c-8d390ad3ffdd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.478916] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.479038] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.479096] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.479246] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.479667] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.479667] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64d5aaad-612c-45e4-8c2c-8d390ad3ffdd',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.981370] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.981867] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.981867] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.981867] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.982035] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.982356] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.982535] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.982535] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.982703] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.982780] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.982878] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64d5aaad-612c-45e4-8c2c-8d390ad3ffdd is going to be updated. [ 955.015449] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.015817] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.015979] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.016294] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.016880] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.028556] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64d5aaad-612c-45e4-8c2c-8d390ad3ffdd in Status: IN_PROGRESS for 2s [ 955.152482] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3172accd-a4e8-4297-999e-158d19f8d74b in Status: SUCCESS [ 955.152861] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3172accd-a4e8-4297-999e-158d19f8d74b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.153088] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3172accd-a4e8-4297-999e-158d19f8d74b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.153367] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3172accd-a4e8-4297-999e-158d19f8d74b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.153592] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.153725] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.153809] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.153920] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.154022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.154094] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3172accd-a4e8-4297-999e-158d19f8d74b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.154190] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3172accd-a4e8-4297-999e-158d19f8d74b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.238792] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: def9aa42-470d-498e-9034-6879fb1e6ebc in Status: SUCCESS [ 955.238792] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.656715] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-3172accd-a4e8-4297-999e-158d19f8d74b taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.656851] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3172accd-a4e8-4297-999e-158d19f8d74b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.656909] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3172accd-a4e8-4297-999e-158d19f8d74b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.657274] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3172accd-a4e8-4297-999e-158d19f8d74b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.657548] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.658428] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.658549] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.658816] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.658937] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.659219] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3172accd-a4e8-4297-999e-158d19f8d74b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.659368] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-3172accd-a4e8-4297-999e-158d19f8d74b taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.659368] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3172accd-a4e8-4297-999e-158d19f8d74b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.659588] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3172accd-a4e8-4297-999e-158d19f8d74b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.659588] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3172accd-a4e8-4297-999e-158d19f8d74b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.659736] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.659863] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.659863] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.660130] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.660130] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.660270] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3172accd-a4e8-4297-999e-158d19f8d74b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.660270] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3172accd-a4e8-4297-999e-158d19f8d74b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.675548] env[70614]: INFO networking_nsxv3.common.synchronization [req-5870a6dd-9e89-49cb-933a-7b5f7d20bb42 req-c01d6332-ed79-4c7b-a8bd-45de98be77e8 tempest-ServersAdminTestJSON-365827888 tempest-ServersAdminTestJSON-365827888-project-member] Enqueued Resource ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b with Priority: HIGHEST for action security_group_members [ 955.676129] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b with Priority: HIGHEST for action security_group_members [ 955.676446] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.676575] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.676644] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.677089] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.677520] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.677520] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.677520] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.677732] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.677778] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.677838] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.162546] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3172accd-a4e8-4297-999e-158d19f8d74b: rpc.has_security_group_logging(os_id): False [ 956.184356] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.184606] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.184606] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.185066] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.185348] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.185689] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.186021] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.186146] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.186509] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.186641] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.187087] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.187336] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.187511] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.187764] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.187872] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.188226] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.188392] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.188572] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.188881] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.189087] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.189222] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3172accd-a4e8-4297-999e-158d19f8d74b is going to be created. [ 956.191137] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.287868] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.288581] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.288581] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.288581] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.288581] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.296387] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49dd754e-129e-49c8-9e52-09796cb64337 in Status: SUCCESS [ 956.296694] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.304557] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3172accd-a4e8-4297-999e-158d19f8d74b in Status: IN_PROGRESS for 2s [ 956.694246] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.042570] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64d5aaad-612c-45e4-8c2c-8d390ad3ffdd in Status: SUCCESS [ 957.042570] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64d5aaad-612c-45e4-8c2c-8d390ad3ffdd deletion is rescheduled due to dependency. [ 957.042570] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64d5aaad-612c-45e4-8c2c-8d390ad3ffdd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.196878] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.197283] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.197283] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.197407] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.197501] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.197621] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b is going to be updated. [ 957.263573] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.263850] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.263850] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.264121] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.264323] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.274824] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b in Status: IN_PROGRESS for 2s [ 958.322020] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3172accd-a4e8-4297-999e-158d19f8d74b in Status: SUCCESS [ 958.322397] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3172accd-a4e8-4297-999e-158d19f8d74b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.730628] env[70614]: INFO networking_nsxv3.common.synchronization [req-82e90f25-daab-4700-bad1-276303700442 req-7c7441d4-2329-4d6d-9c37-f58ea8c75a5a tempest-ImagesOneServerNegativeTestJSON-1769697081 tempest-ImagesOneServerNegativeTestJSON-1769697081-project-member] Enqueued Resource ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e with Priority: HIGHEST for action security_group_members [ 958.732615] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e with Priority: HIGHEST for action security_group_members [ 958.732964] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-3060abf5-a0d6-4fce-88da-15f03f632b6e taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.733130] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.733195] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.733396] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.733548] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.733647] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.733701] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.733844] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.733957] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.734075] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3060abf5-a0d6-4fce-88da-15f03f632b6e',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.238505] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.238701] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.238790] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.239049] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.239159] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.239343] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.239451] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.239541] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.239622] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.239705] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.239811] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e is going to be updated. [ 959.273556] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.273896] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.273896] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.274032] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.274437] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.286661] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b in Status: SUCCESS [ 959.286902] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.289219] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e in Status: IN_PROGRESS for 2s [ 960.371380] env[70614]: INFO networking_nsxv3.common.synchronization [req-374bc7b1-06da-44ee-8129-0e155c7277fb req-35210cc1-59a4-4aa3-b2e8-ea725c80f107 tempest-DeleteServersTestJSON-1690139659 tempest-DeleteServersTestJSON-1690139659-project-member] Enqueued Resource ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f with Priority: HIGHEST for action security_group_members [ 960.371770] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f with Priority: HIGHEST for action security_group_members [ 960.372175] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.372342] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.372428] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.372728] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.372925] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.373064] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.373162] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.373359] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.373750] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.373885] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df8f20f5-6e92-4ac4-bdd2-05863ac4905f',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.712209] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-707 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.712410] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-707" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.712539] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-707" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.712888] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-707" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.713204] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.713373] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.713509] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.713756] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.713905] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.714130] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 960.714248] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 960.714362] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 960.714474] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 960.714586] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 960.714694] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 960.714825] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 960.734732] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 960.734907] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 960.735069] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 960.735500] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-707" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.735734] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-5cce1927-3595-49fc-af98-8e18ebccb0f6 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.735976] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-5cce1927-3595-49fc-af98-8e18ebccb0f6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.736132] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-5cce1927-3595-49fc-af98-8e18ebccb0f6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.736464] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-5cce1927-3595-49fc-af98-8e18ebccb0f6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.736614] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5cce1927-3595-49fc-af98-8e18ebccb0f6',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.877017] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.877017] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.877017] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.877243] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.877359] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.877677] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.877677] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.877897] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.877897] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.877991] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.877991] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f is going to be updated. [ 960.905443] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.905589] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.905704] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.905859] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.906010] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.914338] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f in Status: IN_PROGRESS for 2s [ 961.238842] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.239201] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.239642] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.239711] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.239820] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.239985] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 5cce1927-3595-49fc-af98-8e18ebccb0f6 not found, creating... [ 961.240288] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.240455] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.240575] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.240808] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.240953] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.241300] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.241519] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.241625] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.241797] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.241936] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.242159] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 5cce1927-3595-49fc-af98-8e18ebccb0f6 is going to be created. [ 961.264885] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.265197] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.265291] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.265537] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.265769] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.266120] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-5cce1927-3595-49fc-af98-8e18ebccb0f6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.299241] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e in Status: SUCCESS [ 961.299466] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e deletion is rescheduled due to dependency. [ 961.299564] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.956493] env[70614]: INFO networking_nsxv3.common.synchronization [req-374bc7b1-06da-44ee-8129-0e155c7277fb req-bbaf2e05-8735-4741-9646-146a13cd4d7f service nova] Enqueued Resource ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f with Priority: HIGHEST for action security_group_rules [ 961.956730] env[70614]: INFO networking_nsxv3.common.synchronization [req-374bc7b1-06da-44ee-8129-0e155c7277fb req-bbaf2e05-8735-4741-9646-146a13cd4d7f service nova] Enqueued Resource ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f with Priority: HIGHEST for action security_group_members [ 961.956822] env[70614]: INFO networking_nsxv3.common.synchronization [req-374bc7b1-06da-44ee-8129-0e155c7277fb req-bbaf2e05-8735-4741-9646-146a13cd4d7f service nova] Enqueued Resource ID: 5cce1927-3595-49fc-af98-8e18ebccb0f6 with Priority: HIGHEST for action port [ 961.957068] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f with Priority: HIGHEST for action security_group_rules [ 961.957196] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f with Priority: HIGHEST for action security_group_members [ 961.957291] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5cce1927-3595-49fc-af98-8e18ebccb0f6 with Priority: HIGHEST for action port [ 961.957840] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df8f20f5-6e92-4ac4-bdd2-05863ac4905f taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.957969] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.958260] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.958509] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.958613] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df8f20f5-6e92-4ac4-bdd2-05863ac4905f',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.959596] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.959596] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.959839] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-5cce1927-3595-49fc-af98-8e18ebccb0f6 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.959976] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5cce1927-3595-49fc-af98-8e18ebccb0f6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.960079] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5cce1927-3595-49fc-af98-8e18ebccb0f6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.960276] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5cce1927-3595-49fc-af98-8e18ebccb0f6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.960383] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5cce1927-3595-49fc-af98-8e18ebccb0f6',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.462038] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.462038] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.462297] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5cce1927-3595-49fc-af98-8e18ebccb0f6 with status ACTIVE [ 962.462377] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.462486] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.462554] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.462767] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.462862] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.463087] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.463146] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.463245] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.463423] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.463486] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.463674] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.463816] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.463869] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.464040] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.464127] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.464235] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5cce1927-3595-49fc-af98-8e18ebccb0f6 is going to be updated. [ 962.496188] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.496400] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.496400] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.496736] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.496987] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.497233] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5cce1927-3595-49fc-af98-8e18ebccb0f6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.927063] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f in Status: SUCCESS [ 962.927063] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f deletion is rescheduled due to dependency. [ 962.927063] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.927063] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.927063] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.927063] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.927063] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.927063] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.927063] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.927063] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.927063] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df8f20f5-6e92-4ac4-bdd2-05863ac4905f',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.428976] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('df8f20f5-6e92-4ac4-bdd2-05863ac4905f',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.931812] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('df8f20f5-6e92-4ac4-bdd2-05863ac4905f',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.011023] env[70614]: INFO networking_nsxv3.common.synchronization [req-2fa67a68-37db-4790-a27a-031fbc38267d req-9509a237-370a-42df-a82f-c89755cbcc5e tempest-ServerAddressesTestJSON-900382373 tempest-ServerAddressesTestJSON-900382373-project-member] Enqueued Resource ID: 3172accd-a4e8-4297-999e-158d19f8d74b with Priority: HIGHEST for action security_group_members [ 964.011023] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3172accd-a4e8-4297-999e-158d19f8d74b with Priority: HIGHEST for action security_group_members [ 964.011023] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-3172accd-a4e8-4297-999e-158d19f8d74b taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.011023] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3172accd-a4e8-4297-999e-158d19f8d74b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.011023] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3172accd-a4e8-4297-999e-158d19f8d74b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.011023] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3172accd-a4e8-4297-999e-158d19f8d74b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.011023] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.011023] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.011511] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.011511] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.011511] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.011511] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3172accd-a4e8-4297-999e-158d19f8d74b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.435775] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.436226] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.436226] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.436226] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.436374] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.436422] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f is going to be updated. [ 964.467195] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.467755] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.467755] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.467755] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.467755] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.477644] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f in Status: IN_PROGRESS for 2s [ 964.514722] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.514900] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.514956] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.515306] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.515422] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.515756] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.515756] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.515911] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.515954] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.515994] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.516097] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3172accd-a4e8-4297-999e-158d19f8d74b is going to be updated. [ 964.542086] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.542209] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.542613] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.542613] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.542613] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.551259] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3172accd-a4e8-4297-999e-158d19f8d74b in Status: IN_PROGRESS for 2s [ 964.997959] env[70614]: INFO networking_nsxv3.common.synchronization [req-0021f153-d845-443a-b379-19ae0956bcc9 req-ce29f7f5-f64d-415e-b573-ba3e9fc7790a tempest-ServersNegativeTestJSON-1078216700 tempest-ServersNegativeTestJSON-1078216700-project-member] Enqueued Resource ID: 4be97761-0b55-45fd-ba63-8ef18d95b9f2 with Priority: HIGHEST for action security_group_members [ 964.998520] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4be97761-0b55-45fd-ba63-8ef18d95b9f2 with Priority: HIGHEST for action security_group_members [ 964.998846] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-4be97761-0b55-45fd-ba63-8ef18d95b9f2 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.999253] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.999360] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.999560] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.999725] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.999829] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.999890] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.000077] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.000167] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.000266] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4be97761-0b55-45fd-ba63-8ef18d95b9f2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.503672] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4be97761-0b55-45fd-ba63-8ef18d95b9f2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.609759] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-20 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.611196] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-20" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.611196] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-20" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.611196] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-20" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.611196] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.611750] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.612052] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.612432] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.612721] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.613081] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 965.613338] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 965.613605] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 965.615054] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 965.615054] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 965.615054] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 965.615054] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 965.637378] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 965.637378] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 965.637378] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 965.637378] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-20" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.637378] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-92c5a8a4-7f1b-46c3-8e30-8df658a9b211 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.637378] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-92c5a8a4-7f1b-46c3-8e30-8df658a9b211" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.637378] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-92c5a8a4-7f1b-46c3-8e30-8df658a9b211" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.637378] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-92c5a8a4-7f1b-46c3-8e30-8df658a9b211" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.637378] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92c5a8a4-7f1b-46c3-8e30-8df658a9b211',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.006458] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4be97761-0b55-45fd-ba63-8ef18d95b9f2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.140327] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.140975] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.141281] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.141620] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.142093] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.142288] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 92c5a8a4-7f1b-46c3-8e30-8df658a9b211 not found, creating... [ 966.142589] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.142763] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.142882] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.143143] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.144536] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.144536] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.144536] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.144536] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.144536] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.144536] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.144536] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 92c5a8a4-7f1b-46c3-8e30-8df658a9b211 is going to be created. [ 966.171028] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.171028] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.171028] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.171471] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.171724] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.171948] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-92c5a8a4-7f1b-46c3-8e30-8df658a9b211" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.488928] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f in Status: SUCCESS [ 966.489248] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.489449] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.489675] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.489947] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.490211] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.490995] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.491256] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.491359] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.491487] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.491594] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('df8f20f5-6e92-4ac4-bdd2-05863ac4905f',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.510174] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.510479] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.510479] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.510591] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.510673] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.510767] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4be97761-0b55-45fd-ba63-8ef18d95b9f2 is going to be updated. [ 966.541013] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.541013] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.541013] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.541295] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.541430] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.550895] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4be97761-0b55-45fd-ba63-8ef18d95b9f2 in Status: IN_PROGRESS for 2s [ 966.562246] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3172accd-a4e8-4297-999e-158d19f8d74b in Status: SUCCESS [ 966.563434] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3172accd-a4e8-4297-999e-158d19f8d74b deletion is rescheduled due to dependency. [ 966.563434] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3172accd-a4e8-4297-999e-158d19f8d74b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.994753] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.995056] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.995056] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.995320] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.998383] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.998383] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.998383] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.998383] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.998383] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.998383] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.998383] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.998383] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.998383] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.998383] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.998383] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.998383] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.998383] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.998383] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.998383] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.998383] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.998383] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('df8f20f5-6e92-4ac4-bdd2-05863ac4905f',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.165027] env[70614]: INFO networking_nsxv3.common.synchronization [req-0021f153-d845-443a-b379-19ae0956bcc9 req-051a4cbf-6aad-4331-bcbc-25aded829798 service nova] Enqueued Resource ID: 4be97761-0b55-45fd-ba63-8ef18d95b9f2 with Priority: HIGHEST for action security_group_rules [ 967.165027] env[70614]: INFO networking_nsxv3.common.synchronization [req-0021f153-d845-443a-b379-19ae0956bcc9 req-051a4cbf-6aad-4331-bcbc-25aded829798 service nova] Enqueued Resource ID: 4be97761-0b55-45fd-ba63-8ef18d95b9f2 with Priority: HIGHEST for action security_group_members [ 967.165027] env[70614]: INFO networking_nsxv3.common.synchronization [req-0021f153-d845-443a-b379-19ae0956bcc9 req-051a4cbf-6aad-4331-bcbc-25aded829798 service nova] Enqueued Resource ID: 92c5a8a4-7f1b-46c3-8e30-8df658a9b211 with Priority: HIGHEST for action port [ 967.165466] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4be97761-0b55-45fd-ba63-8ef18d95b9f2 with Priority: HIGHEST for action security_group_rules [ 967.165466] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4be97761-0b55-45fd-ba63-8ef18d95b9f2 with Priority: HIGHEST for action security_group_members [ 967.165580] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92c5a8a4-7f1b-46c3-8e30-8df658a9b211 with Priority: HIGHEST for action port [ 967.166333] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4be97761-0b55-45fd-ba63-8ef18d95b9f2 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.166333] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.166333] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.166333] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.166333] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4be97761-0b55-45fd-ba63-8ef18d95b9f2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.167232] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-4be97761-0b55-45fd-ba63-8ef18d95b9f2 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.167325] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.168027] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-92c5a8a4-7f1b-46c3-8e30-8df658a9b211 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.168027] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-92c5a8a4-7f1b-46c3-8e30-8df658a9b211" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.168027] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-92c5a8a4-7f1b-46c3-8e30-8df658a9b211" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.168027] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-92c5a8a4-7f1b-46c3-8e30-8df658a9b211" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.168027] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92c5a8a4-7f1b-46c3-8e30-8df658a9b211',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.500156] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for df8f20f5-6e92-4ac4-bdd2-05863ac4905f: rpc.has_security_group_logging(os_id): False [ 967.519609] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.519958] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.519958] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.520177] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.520323] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.520606] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.520746] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.520856] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.521087] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.521157] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.521395] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.521537] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.521605] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.521788] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.521890] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.522302] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.522443] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.522534] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.522727] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.522833] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.522947] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f is going to be updated. [ 967.583803] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.583953] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.588032] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.588032] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.588032] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.614026] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f in Status: IN_PROGRESS for 2s [ 967.669292] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-4be97761-0b55-45fd-ba63-8ef18d95b9f2 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.669427] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.669666] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 92c5a8a4-7f1b-46c3-8e30-8df658a9b211 with status ACTIVE [ 967.669821] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.669931] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.670021] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.670227] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.670319] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.670489] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.670588] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.670649] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.670805] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.670881] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.671790] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.671790] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.671790] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.671790] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.671790] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.671790] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 92c5a8a4-7f1b-46c3-8e30-8df658a9b211 is going to be updated. [ 967.702616] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.703016] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.703016] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.703095] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.703229] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.703441] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-92c5a8a4-7f1b-46c3-8e30-8df658a9b211" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.902052] env[70614]: INFO networking_nsxv3.common.synchronization [req-c7ffc52b-3f2e-46c9-b274-ae928c9aeb96 req-7cd4986a-83f6-4067-93ea-263f93f4d88d tempest-ServerDiagnosticsTest-143865555 tempest-ServerDiagnosticsTest-143865555-project-member] Enqueued Resource ID: 0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62 with Priority: HIGHEST for action security_group_members [ 967.902731] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62 with Priority: HIGHEST for action security_group_members [ 967.903152] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.903343] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.903440] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.903714] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.903889] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.903997] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.904071] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.904224] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.904307] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.904408] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.383270] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-573 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.383270] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-573" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.383270] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-573" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.383270] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-573" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.383966] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.387019] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.387019] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.387019] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.387019] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.387019] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 968.387019] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 968.387019] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 968.387019] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 968.387019] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 968.387019] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 968.387019] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 968.407286] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 968.407777] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 968.408111] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 968.410119] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-573" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.410119] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-dd361339-8664-4f48-bcd2-998efaf56ab7 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.410119] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-dd361339-8664-4f48-bcd2-998efaf56ab7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.410119] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-dd361339-8664-4f48-bcd2-998efaf56ab7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.410119] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-dd361339-8664-4f48-bcd2-998efaf56ab7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.410119] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd361339-8664-4f48-bcd2-998efaf56ab7',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.411918] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.412377] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.412607] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.412909] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.413120] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.413435] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.413706] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.413883] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.415100] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.415100] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.415100] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62 already deleted. [ 968.415100] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.548099] env[70614]: INFO networking_nsxv3.common.synchronization [None req-cf5b4340-b061-4c28-8372-170bb663de89 None None] Enqueued Resource ID: 2a4789ff-de24-45b8-a8ee-12e01dda3b4b with Priority: HIGHEST for action port [ 968.548099] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a4789ff-de24-45b8-a8ee-12e01dda3b4b with Priority: HIGHEST for action port [ 968.548099] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-2a4789ff-de24-45b8-a8ee-12e01dda3b4b taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.548099] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2a4789ff-de24-45b8-a8ee-12e01dda3b4b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.548099] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2a4789ff-de24-45b8-a8ee-12e01dda3b4b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.548099] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2a4789ff-de24-45b8-a8ee-12e01dda3b4b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.548099] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a4789ff-de24-45b8-a8ee-12e01dda3b4b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.561241] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4be97761-0b55-45fd-ba63-8ef18d95b9f2 in Status: SUCCESS [ 968.563344] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.563344] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.563344] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.563344] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.563344] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.563344] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.563344] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.563344] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.563344] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4be97761-0b55-45fd-ba63-8ef18d95b9f2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.915686] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.915968] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.916146] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.916438] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.916591] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.916749] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port dd361339-8664-4f48-bcd2-998efaf56ab7 not found, creating... [ 968.917062] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.917253] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.917408] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.917683] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.917759] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.918140] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.918385] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.918451] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.918674] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.919167] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.919380] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: dd361339-8664-4f48-bcd2-998efaf56ab7 is going to be created. [ 968.947815] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.947815] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.947815] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.948058] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.948333] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.948581] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-dd361339-8664-4f48-bcd2-998efaf56ab7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.054540] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2a4789ff-de24-45b8-a8ee-12e01dda3b4b [ 969.055175] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.055175] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.055175] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.055409] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.055409] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.055465] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2a4789ff-de24-45b8-a8ee-12e01dda3b4b already deleted. [ 969.056038] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2a4789ff-de24-45b8-a8ee-12e01dda3b4b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.069248] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4be97761-0b55-45fd-ba63-8ef18d95b9f2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.551541] env[70614]: INFO networking_nsxv3.common.synchronization [req-cfd1ea38-70a5-4528-b3c9-a55d674f79a6 req-c485dbf0-1e36-4782-a7ab-2aaf256589a2 tempest-ServersTestMultiNic-1290380047 tempest-ServersTestMultiNic-1290380047-project-member] Enqueued Resource ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 with Priority: HIGHEST for action security_group_members [ 969.556238] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 with Priority: HIGHEST for action security_group_members [ 969.556509] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.556693] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.556792] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.557116] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.557336] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.557572] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.557572] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.558055] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.558055] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.558055] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.575183] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4be97761-0b55-45fd-ba63-8ef18d95b9f2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.631337] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f in Status: SUCCESS [ 969.631558] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.064027] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.064027] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.064027] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.064027] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.064027] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.064221] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.064280] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.064480] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.064480] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.064581] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.064614] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 is going to be updated. [ 970.077946] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.077946] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.077946] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.078130] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.078535] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.078535] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4be97761-0b55-45fd-ba63-8ef18d95b9f2 is going to be updated. [ 970.086597] env[70614]: INFO networking_nsxv3.common.synchronization [req-49516d75-bf06-48e4-8cbb-2204d459f104 req-ea637902-8f93-4100-9d97-584a308d684d tempest-MigrationsAdminTest-2080415140 tempest-MigrationsAdminTest-2080415140-project-member] Enqueued Resource ID: 49dd754e-129e-49c8-9e52-09796cb64337 with Priority: HIGHEST for action security_group_members [ 970.086889] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49dd754e-129e-49c8-9e52-09796cb64337 with Priority: HIGHEST for action security_group_members [ 970.087905] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-49dd754e-129e-49c8-9e52-09796cb64337 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.090087] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.090087] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.090392] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.090554] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.091134] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.091134] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.091134] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.091134] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.091134] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49dd754e-129e-49c8-9e52-09796cb64337',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.095471] env[70614]: INFO networking_nsxv3.common.synchronization [req-c7ffc52b-3f2e-46c9-b274-ae928c9aeb96 req-c0ef67b6-b790-41a0-8784-edf22cac0eb1 service nova] Enqueued Resource ID: 0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62 with Priority: HIGHEST for action security_group_rules [ 970.095471] env[70614]: INFO networking_nsxv3.common.synchronization [req-c7ffc52b-3f2e-46c9-b274-ae928c9aeb96 req-c0ef67b6-b790-41a0-8784-edf22cac0eb1 service nova] Enqueued Resource ID: 0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62 with Priority: HIGHEST for action security_group_members [ 970.095471] env[70614]: INFO networking_nsxv3.common.synchronization [req-c7ffc52b-3f2e-46c9-b274-ae928c9aeb96 req-c0ef67b6-b790-41a0-8784-edf22cac0eb1 service nova] Enqueued Resource ID: dd361339-8664-4f48-bcd2-998efaf56ab7 with Priority: HIGHEST for action port [ 970.095471] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62 with Priority: HIGHEST for action security_group_rules [ 970.095471] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62 with Priority: HIGHEST for action security_group_members [ 970.095471] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd361339-8664-4f48-bcd2-998efaf56ab7 with Priority: HIGHEST for action port [ 970.095471] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.095471] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.095471] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.095471] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.095471] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.096454] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.096573] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.096639] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.096844] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.096948] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.097054] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.097113] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.097252] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.097343] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.097413] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.098483] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-dd361339-8664-4f48-bcd2-998efaf56ab7 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.098610] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dd361339-8664-4f48-bcd2-998efaf56ab7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.098657] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dd361339-8664-4f48-bcd2-998efaf56ab7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.098796] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dd361339-8664-4f48-bcd2-998efaf56ab7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.098869] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd361339-8664-4f48-bcd2-998efaf56ab7',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.102133] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.102133] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.102133] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.102133] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.102133] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.113526] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 in Status: IN_PROGRESS for 2s [ 970.115552] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.115696] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.115763] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.116487] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.116487] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.126094] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4be97761-0b55-45fd-ba63-8ef18d95b9f2 in Status: IN_PROGRESS for 2s [ 970.255653] env[70614]: INFO networking_nsxv3.common.synchronization [req-cfd1ea38-70a5-4528-b3c9-a55d674f79a6 req-8d766345-94ba-47eb-803b-5548474ba644 tempest-ServersTestMultiNic-1290380047 tempest-ServersTestMultiNic-1290380047-project-member] Enqueued Resource ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 with Priority: HIGHEST for action security_group_members [ 970.256252] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 with Priority: HIGHEST for action security_group_members [ 970.256592] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.256690] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.594521] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.594954] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.594954] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.595056] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.595095] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.595310] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.595411] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.595473] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.595641] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.595720] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.595810] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49dd754e-129e-49c8-9e52-09796cb64337 is going to be updated. [ 970.601034] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.602371] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.602503] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.606591] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dd361339-8664-4f48-bcd2-998efaf56ab7 with status ACTIVE [ 970.607398] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.607398] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.607398] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.607398] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.607598] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.607598] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.607929] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.607929] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.607929] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.608067] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.608299] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.608400] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.608464] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.608612] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.608689] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.608775] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dd361339-8664-4f48-bcd2-998efaf56ab7 is going to be updated. [ 970.631088] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.631314] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.631392] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.631608] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.631786] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.633802] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.634464] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.634728] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.635413] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.635595] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.636017] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dd361339-8664-4f48-bcd2-998efaf56ab7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.640060] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-64 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.640210] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-64" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.641458] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-64" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.641458] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-64" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.641458] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.641458] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.641458] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.641458] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.641786] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.642087] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 970.642247] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 970.642390] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 970.642526] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 970.642669] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 970.642819] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 970.642987] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 970.650067] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49dd754e-129e-49c8-9e52-09796cb64337 in Status: IN_PROGRESS for 2s [ 970.661973] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 970.662620] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 970.662620] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 970.662788] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-64" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.663166] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-9fcb9826-ff01-454f-bbbd-f7441c507171 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.663403] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-9fcb9826-ff01-454f-bbbd-f7441c507171" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.664017] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-9fcb9826-ff01-454f-bbbd-f7441c507171" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.664017] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-9fcb9826-ff01-454f-bbbd-f7441c507171" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.664186] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9fcb9826-ff01-454f-bbbd-f7441c507171',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.108408] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.172023] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.172023] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.172023] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.172023] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.172023] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.172023] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 9fcb9826-ff01-454f-bbbd-f7441c507171 not found, creating... [ 971.172023] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.172023] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.172023] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.172023] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.172023] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.173208] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.173835] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.174545] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.175974] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.175974] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.175974] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 9fcb9826-ff01-454f-bbbd-f7441c507171 is going to be created. [ 971.229172] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.229870] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.231566] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.231566] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.231566] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.231566] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-9fcb9826-ff01-454f-bbbd-f7441c507171" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.612793] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.612793] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.612793] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.613320] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.613457] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.613696] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62 is going to be created. [ 971.644876] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.644876] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.644876] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.645533] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.645850] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.654517] env[70614]: INFO networking_nsxv3.common.synchronization [None req-038eea09-a1c3-4582-8a79-07a68a73404c None None] Enqueued Resource ID: 11abd70f-ded7-47d5-bc54-cbdfd82193d1 with Priority: HIGHEST for action port [ 971.655084] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11abd70f-ded7-47d5-bc54-cbdfd82193d1 with Priority: HIGHEST for action port [ 971.656190] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-11abd70f-ded7-47d5-bc54-cbdfd82193d1 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.657842] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-11abd70f-ded7-47d5-bc54-cbdfd82193d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.658080] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-11abd70f-ded7-47d5-bc54-cbdfd82193d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.658503] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-11abd70f-ded7-47d5-bc54-cbdfd82193d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.658743] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('11abd70f-ded7-47d5-bc54-cbdfd82193d1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.660573] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62 in Status: UNINITIALIZED for 2s [ 971.986306] env[70614]: INFO networking_nsxv3.common.synchronization [req-cfd1ea38-70a5-4528-b3c9-a55d674f79a6 req-9db120b6-b0c2-44f8-9622-bcf426a741f5 service nova] Enqueued Resource ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 with Priority: HIGHEST for action security_group_rules [ 971.986513] env[70614]: INFO networking_nsxv3.common.synchronization [req-cfd1ea38-70a5-4528-b3c9-a55d674f79a6 req-9db120b6-b0c2-44f8-9622-bcf426a741f5 service nova] Enqueued Resource ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 with Priority: HIGHEST for action security_group_members [ 971.986977] env[70614]: INFO networking_nsxv3.common.synchronization [req-cfd1ea38-70a5-4528-b3c9-a55d674f79a6 req-9db120b6-b0c2-44f8-9622-bcf426a741f5 service nova] Enqueued Resource ID: 9fcb9826-ff01-454f-bbbd-f7441c507171 with Priority: HIGHEST for action port [ 971.987550] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 with Priority: HIGHEST for action security_group_rules [ 971.988371] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 with Priority: HIGHEST for action security_group_members [ 971.988591] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fcb9826-ff01-454f-bbbd-f7441c507171 with Priority: HIGHEST for action port [ 971.989070] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.989481] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.989643] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.989994] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.990191] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.991117] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.991316] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.991525] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-9fcb9826-ff01-454f-bbbd-f7441c507171 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.991681] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9fcb9826-ff01-454f-bbbd-f7441c507171" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.991788] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9fcb9826-ff01-454f-bbbd-f7441c507171" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.992046] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9fcb9826-ff01-454f-bbbd-f7441c507171" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.992177] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9fcb9826-ff01-454f-bbbd-f7441c507171',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.123432] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 in Status: IN_PROGRESS for 4s [ 972.135811] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4be97761-0b55-45fd-ba63-8ef18d95b9f2 in Status: IN_PROGRESS for 4s [ 972.162127] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 11abd70f-ded7-47d5-bc54-cbdfd82193d1 [ 972.163644] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.163644] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.163644] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.163644] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.163644] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.163644] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:11abd70f-ded7-47d5-bc54-cbdfd82193d1 already deleted. [ 972.163644] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-11abd70f-ded7-47d5-bc54-cbdfd82193d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.248321] env[70614]: INFO networking_nsxv3.common.synchronization [None req-349bd33a-457c-4d0d-baef-22ab409e437c tempest-AttachInterfacesTestJSON-1919943007 tempest-AttachInterfacesTestJSON-1919943007-project-member] Enqueued Resource ID: ca55d9c7-11be-476b-bdb5-63e4c956a4de with Priority: HIGHEST for action security_group_rules [ 972.249332] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca55d9c7-11be-476b-bdb5-63e4c956a4de with Priority: HIGHEST for action security_group_rules [ 972.249332] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca55d9c7-11be-476b-bdb5-63e4c956a4de taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.249332] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca55d9c7-11be-476b-bdb5-63e4c956a4de" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.249332] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca55d9c7-11be-476b-bdb5-63e4c956a4de" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.249819] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca55d9c7-11be-476b-bdb5-63e4c956a4de" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.249819] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca55d9c7-11be-476b-bdb5-63e4c956a4de',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.351596] env[70614]: INFO networking_nsxv3.common.synchronization [None req-1699cd17-dfc7-4364-bc55-58db66e9f8de tempest-AttachInterfacesTestJSON-1919943007 tempest-AttachInterfacesTestJSON-1919943007-project-member] Enqueued Resource ID: ca55d9c7-11be-476b-bdb5-63e4c956a4de with Priority: HIGHEST for action security_group_rules [ 972.351945] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca55d9c7-11be-476b-bdb5-63e4c956a4de with Priority: HIGHEST for action security_group_rules [ 972.352879] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca55d9c7-11be-476b-bdb5-63e4c956a4de taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.352879] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca55d9c7-11be-476b-bdb5-63e4c956a4de" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.494288] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.494288] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.498127] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9fcb9826-ff01-454f-bbbd-f7441c507171 with status ACTIVE [ 972.498127] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.498127] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.498127] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.498127] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.498127] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.498127] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.498127] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.498127] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.498127] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.498127] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.498127] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.498127] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.498127] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.498127] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.498127] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.498127] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9fcb9826-ff01-454f-bbbd-f7441c507171 is going to be updated. [ 972.524654] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.524835] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.524877] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.527022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.527022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.527022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9fcb9826-ff01-454f-bbbd-f7441c507171" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.662150] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49dd754e-129e-49c8-9e52-09796cb64337 in Status: SUCCESS [ 972.662497] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49dd754e-129e-49c8-9e52-09796cb64337 deletion is rescheduled due to dependency. [ 972.662497] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.776031] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.776194] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.776272] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.776470] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.776558] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.778212] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca55d9c7-11be-476b-bdb5-63e4c956a4de already deleted. [ 972.778389] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca55d9c7-11be-476b-bdb5-63e4c956a4de" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.778572] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca55d9c7-11be-476b-bdb5-63e4c956a4de" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.778764] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca55d9c7-11be-476b-bdb5-63e4c956a4de" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.778855] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca55d9c7-11be-476b-bdb5-63e4c956a4de',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.303514] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.303514] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.303706] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.303973] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.304114] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.304243] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca55d9c7-11be-476b-bdb5-63e4c956a4de already deleted. [ 973.304357] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca55d9c7-11be-476b-bdb5-63e4c956a4de" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.672037] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62 in Status: SUCCESS [ 973.672037] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.672037] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.672037] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.672037] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.672037] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.672037] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.672037] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.672037] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.672037] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.672037] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.794040] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-78 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.794253] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-78" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.794407] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-78" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.794811] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-78" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.795136] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.795333] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.795531] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.795828] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.796018] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.796263] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 973.796401] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 973.796516] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 973.796651] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 973.796771] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 973.796880] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 973.797837] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 973.817504] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 973.817675] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 973.817841] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 973.818195] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-78" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.818594] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-f0661a8b-53b9-4b5b-985d-a67d6261a5d4 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.818808] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-f0661a8b-53b9-4b5b-985d-a67d6261a5d4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.818949] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-f0661a8b-53b9-4b5b-985d-a67d6261a5d4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.819910] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-f0661a8b-53b9-4b5b-985d-a67d6261a5d4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.820171] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f0661a8b-53b9-4b5b-985d-a67d6261a5d4',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.135025] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 in Status: SUCCESS [ 974.135242] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 deletion is rescheduled due to dependency. [ 974.136391] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.136391] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.136391] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.136391] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.136391] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.136391] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.136391] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.136391] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.136667] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.148763] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4be97761-0b55-45fd-ba63-8ef18d95b9f2 in Status: SUCCESS [ 974.149101] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.149959] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.149959] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.149959] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.149959] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.149959] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.150380] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.150380] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.150380] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.150380] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4be97761-0b55-45fd-ba63-8ef18d95b9f2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.175330] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.175554] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.175612] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.175856] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.176041] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.176144] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.176354] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.176354] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.176438] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.176507] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.176655] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.176747] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.176807] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.177126] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.177126] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.177231] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.177296] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.177444] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.177549] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.177667] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.177789] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.326591] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.326884] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.327037] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.327353] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.327515] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.327680] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port f0661a8b-53b9-4b5b-985d-a67d6261a5d4 not found, creating... [ 974.328090] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.328317] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.328480] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.328747] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.328897] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.329277] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.329476] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.329601] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.329859] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.329992] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.330237] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: f0661a8b-53b9-4b5b-985d-a67d6261a5d4 is going to be created. [ 974.355743] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.355977] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.356102] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.356450] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.356629] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.356911] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-f0661a8b-53b9-4b5b-985d-a67d6261a5d4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.640301] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.653030] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-4be97761-0b55-45fd-ba63-8ef18d95b9f2 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.653251] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.653251] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.653730] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.653822] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.653964] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.654051] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.654291] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.654415] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.654469] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.654660] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-4be97761-0b55-45fd-ba63-8ef18d95b9f2 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.654785] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.654851] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.655038] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.655191] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.655290] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.655348] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.655539] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.655649] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.655749] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.655839] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4be97761-0b55-45fd-ba63-8ef18d95b9f2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.680603] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62: rpc.has_security_group_logging(os_id): False [ 974.702573] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.702671] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.702806] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.702963] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.703000] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.703303] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.703387] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.703449] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.703735] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.703808] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.704056] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.704130] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.704174] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.704325] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.704415] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.704625] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.704818] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.704883] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.705178] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.705291] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.705470] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62 is going to be created. [ 974.779585] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.779802] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.779855] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.780092] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.780330] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.794124] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62 in Status: IN_PROGRESS for 2s [ 975.144709] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.158511] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4be97761-0b55-45fd-ba63-8ef18d95b9f2: rpc.has_security_group_logging(os_id): False [ 975.177758] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.177942] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.178062] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.178247] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.178339] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.178590] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.178692] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.178760] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.178956] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.179066] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.179247] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.179344] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.179418] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.179560] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.179634] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.179855] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.179951] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.180875] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.181117] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.181246] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.181378] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4be97761-0b55-45fd-ba63-8ef18d95b9f2 is going to be updated. [ 975.196557] env[70614]: INFO networking_nsxv3.common.synchronization [req-cfd1ea38-70a5-4528-b3c9-a55d674f79a6 req-5fc24e46-85a3-45cd-bc47-f0fc537cf729 service nova] Enqueued Resource ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 with Priority: HIGHEST for action security_group_rules [ 975.196772] env[70614]: INFO networking_nsxv3.common.synchronization [req-cfd1ea38-70a5-4528-b3c9-a55d674f79a6 req-5fc24e46-85a3-45cd-bc47-f0fc537cf729 service nova] Enqueued Resource ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 with Priority: HIGHEST for action security_group_members [ 975.196965] env[70614]: INFO networking_nsxv3.common.synchronization [req-cfd1ea38-70a5-4528-b3c9-a55d674f79a6 req-5fc24e46-85a3-45cd-bc47-f0fc537cf729 service nova] Enqueued Resource ID: f0661a8b-53b9-4b5b-985d-a67d6261a5d4 with Priority: HIGHEST for action port [ 975.197700] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 with Priority: HIGHEST for action security_group_rules [ 975.197852] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 with Priority: HIGHEST for action security_group_members [ 975.197954] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0661a8b-53b9-4b5b-985d-a67d6261a5d4 with Priority: HIGHEST for action port [ 975.199087] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.199263] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.199550] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.199698] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.199910] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-f0661a8b-53b9-4b5b-985d-a67d6261a5d4 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.200143] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f0661a8b-53b9-4b5b-985d-a67d6261a5d4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.200245] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f0661a8b-53b9-4b5b-985d-a67d6261a5d4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.200520] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f0661a8b-53b9-4b5b-985d-a67d6261a5d4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.200755] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f0661a8b-53b9-4b5b-985d-a67d6261a5d4',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.249452] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.249679] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.249766] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.250088] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.250321] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.264173] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4be97761-0b55-45fd-ba63-8ef18d95b9f2 in Status: IN_PROGRESS for 2s [ 975.374338] env[70614]: INFO networking_nsxv3.common.synchronization [req-0388b123-7829-451c-8ee0-d9e28d4b52b7 req-a23742d3-af8b-4419-8ef5-a8de13738946 tempest-DeleteServersTestJSON-1690139659 tempest-DeleteServersTestJSON-1690139659-project-member] Enqueued Resource ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f with Priority: HIGHEST for action security_group_members [ 975.374338] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f with Priority: HIGHEST for action security_group_members [ 975.374684] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.374874] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.374974] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.375372] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.375553] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.375668] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.375746] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.375939] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.376051] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.376177] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df8f20f5-6e92-4ac4-bdd2-05863ac4905f',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.647684] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.647684] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.647684] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.647889] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.647889] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.647964] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 is going to be updated. [ 975.679439] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.679636] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.679735] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.679997] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.680199] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.689602] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 in Status: IN_PROGRESS for 2s [ 975.704410] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f0661a8b-53b9-4b5b-985d-a67d6261a5d4 with status ACTIVE [ 975.704696] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.704848] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.705304] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.705304] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.705450] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.705537] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.705660] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.705745] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.705946] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.706050] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.706244] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.706364] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.706452] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.706669] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.706669] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.706824] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f0661a8b-53b9-4b5b-985d-a67d6261a5d4 is going to be updated. [ 975.731860] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.732067] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.732128] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.732474] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.732632] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.732800] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f0661a8b-53b9-4b5b-985d-a67d6261a5d4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.880431] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.881988] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.882103] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.882317] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.882411] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.882620] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.882818] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.882818] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.882964] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.882993] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.883090] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f is going to be updated. [ 975.922347] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.923029] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.923029] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.923029] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.923371] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.938599] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f in Status: IN_PROGRESS for 2s [ 975.943685] env[70614]: INFO networking_nsxv3.common.synchronization [req-1e1828e3-f97c-4e58-968e-65f1e7ecb65e req-6f2a1b3d-33ec-4da9-aad4-ee317222edf3 tempest-ServersAdminTestJSON-365827888 tempest-ServersAdminTestJSON-365827888-project-member] Enqueued Resource ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b with Priority: HIGHEST for action security_group_members [ 975.945021] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b with Priority: HIGHEST for action security_group_members [ 975.946164] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.947184] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.947184] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.947184] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.948765] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.948765] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.948765] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.948765] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.948765] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.948765] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.461277] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.461277] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.461277] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.461592] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.461592] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.461653] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.461867] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.461867] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.462289] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.462404] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.462517] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b is going to be updated. [ 976.489769] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.489926] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.490017] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.491763] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.491983] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.503436] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b in Status: IN_PROGRESS for 2s [ 976.807144] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62 in Status: SUCCESS [ 976.807553] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.280535] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4be97761-0b55-45fd-ba63-8ef18d95b9f2 in Status: SUCCESS [ 977.280535] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.700980] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 in Status: SUCCESS [ 977.701258] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.701412] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.701652] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.701891] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.702106] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.702106] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.702264] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.702264] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.702366] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.949575] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f in Status: SUCCESS [ 977.950300] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f deletion is rescheduled due to dependency. [ 977.950300] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.207432] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.333919] env[70614]: INFO networking_nsxv3.common.synchronization [req-e0838e2e-3fd6-4358-b8eb-f445b10c24f3 req-7bf135de-a070-4166-8571-c65a6c50b99e tempest-ImagesTestJSON-1765947257 tempest-ImagesTestJSON-1765947257-project-member] Enqueued Resource ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 with Priority: HIGHEST for action security_group_members [ 978.336319] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 with Priority: HIGHEST for action security_group_members [ 978.341823] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-04a082fe-52f7-4ac6-a12b-63791c63be86 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.341823] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.341823] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.341823] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.341823] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.341823] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.341823] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.341823] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.341823] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.341823] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04a082fe-52f7-4ac6-a12b-63791c63be86',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.510613] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b in Status: SUCCESS [ 978.510799] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b deletion is rescheduled due to dependency. [ 978.510924] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.702090] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-12 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.702271] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-12" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.703128] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-12" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.703128] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-12" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.703128] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.703128] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.703317] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.703439] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.703601] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.704227] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 978.704227] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 978.704227] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 978.704227] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 978.704422] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 978.704422] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 978.704575] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 978.712309] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.730221] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 978.730656] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 978.730656] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 978.730747] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-12" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.731066] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-fc27e6d9-429c-4462-b785-b806f35520af taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.731426] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-fc27e6d9-429c-4462-b785-b806f35520af" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.731500] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-fc27e6d9-429c-4462-b785-b806f35520af" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.732343] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-fc27e6d9-429c-4462-b785-b806f35520af" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.732610] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc27e6d9-429c-4462-b785-b806f35520af',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.845097] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('04a082fe-52f7-4ac6-a12b-63791c63be86',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.214581] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.214954] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.214954] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.214954] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.215092] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.215162] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 is going to be updated. [ 979.235834] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.236074] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.236299] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.236530] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.236627] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.236783] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port fc27e6d9-429c-4462-b785-b806f35520af not found, creating... [ 979.237316] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.237544] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.237739] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.237920] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.239262] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.239262] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.239395] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.239489] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.239727] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.239852] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.240065] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: fc27e6d9-429c-4462-b785-b806f35520af is going to be created. [ 979.253025] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.253025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.253025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.253025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.253025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.262216] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 in Status: IN_PROGRESS for 2s [ 979.263059] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.263267] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.263396] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.263662] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.263884] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.264124] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-fc27e6d9-429c-4462-b785-b806f35520af" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.347507] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('04a082fe-52f7-4ac6-a12b-63791c63be86',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.850677] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.850860] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.850952] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.851242] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.851343] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.851442] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 is going to be updated. [ 979.881666] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.881833] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.881916] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.882142] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.882223] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.891460] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 in Status: IN_PROGRESS for 2s [ 980.741436] env[70614]: INFO networking_nsxv3.common.synchronization [req-a583d718-48e0-4398-86ae-619a860982e6 req-4c059ca9-793b-4112-855e-7c2ecc2f6791 tempest-ServersNegativeTestJSON-1078216700 tempest-ServersNegativeTestJSON-1078216700-project-member] Enqueued Resource ID: 4be97761-0b55-45fd-ba63-8ef18d95b9f2 with Priority: HIGHEST for action security_group_members [ 980.742799] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4be97761-0b55-45fd-ba63-8ef18d95b9f2 with Priority: HIGHEST for action security_group_members [ 980.744316] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-4be97761-0b55-45fd-ba63-8ef18d95b9f2 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.745383] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.745500] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.745869] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.745929] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.746149] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.746861] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.747134] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.747244] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.747349] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4be97761-0b55-45fd-ba63-8ef18d95b9f2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.793230] env[70614]: INFO networking_nsxv3.common.synchronization [req-e0838e2e-3fd6-4358-b8eb-f445b10c24f3 req-6a885afb-28fb-46ea-b268-088fe7832cb5 service nova] Enqueued Resource ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 with Priority: HIGHEST for action security_group_rules [ 980.793418] env[70614]: INFO networking_nsxv3.common.synchronization [req-e0838e2e-3fd6-4358-b8eb-f445b10c24f3 req-6a885afb-28fb-46ea-b268-088fe7832cb5 service nova] Enqueued Resource ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 with Priority: HIGHEST for action security_group_members [ 980.793562] env[70614]: INFO networking_nsxv3.common.synchronization [req-e0838e2e-3fd6-4358-b8eb-f445b10c24f3 req-6a885afb-28fb-46ea-b268-088fe7832cb5 service nova] Enqueued Resource ID: fc27e6d9-429c-4462-b785-b806f35520af with Priority: HIGHEST for action port [ 980.794032] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 with Priority: HIGHEST for action security_group_rules [ 980.794179] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 with Priority: HIGHEST for action security_group_members [ 980.794910] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc27e6d9-429c-4462-b785-b806f35520af with Priority: HIGHEST for action port [ 980.794910] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-04a082fe-52f7-4ac6-a12b-63791c63be86 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.794910] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.794910] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.794910] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.795304] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('04a082fe-52f7-4ac6-a12b-63791c63be86',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.796676] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-04a082fe-52f7-4ac6-a12b-63791c63be86 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.796852] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.797233] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc27e6d9-429c-4462-b785-b806f35520af taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.797401] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc27e6d9-429c-4462-b785-b806f35520af" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.797500] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc27e6d9-429c-4462-b785-b806f35520af" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.797804] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc27e6d9-429c-4462-b785-b806f35520af" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.797804] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc27e6d9-429c-4462-b785-b806f35520af',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.167544] env[70614]: INFO networking_nsxv3.common.synchronization [req-c6d47ebc-5e6a-4f28-a862-f41c9e5854c2 req-9fb9d226-a458-47c3-a2e3-89b6c00164fc tempest-ServerDiagnosticsTest-143865555 tempest-ServerDiagnosticsTest-143865555-project-member] Enqueued Resource ID: 0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62 with Priority: HIGHEST for action security_group_members [ 981.168119] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62 with Priority: HIGHEST for action security_group_members [ 981.168437] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.168603] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.168642] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.168807] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.168981] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.169328] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.169422] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.169601] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.169780] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.169905] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.250880] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4be97761-0b55-45fd-ba63-8ef18d95b9f2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.285429] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 in Status: SUCCESS [ 981.285672] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.286076] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.286273] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.286467] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.286584] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.286649] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.286815] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.286896] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.286985] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.287117] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.287915] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.289560] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.289820] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.289986] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.290112] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.290310] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.290399] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.290496] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.300703] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-04a082fe-52f7-4ac6-a12b-63791c63be86 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.300703] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.306025] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fc27e6d9-429c-4462-b785-b806f35520af with status ACTIVE [ 981.306025] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.306025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.306025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.306025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.306025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.306025] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.306025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.306025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.306025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.306025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.306025] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.306025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.306025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.306025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.306025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.306025] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fc27e6d9-429c-4462-b785-b806f35520af is going to be updated. [ 981.337196] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.337196] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.337196] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.337196] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.337196] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.337196] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc27e6d9-429c-4462-b785-b806f35520af" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.673681] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.675837] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.675837] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.675837] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.675837] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.675837] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.675837] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.675837] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.675837] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.675837] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.675837] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62 is going to be updated. [ 981.709383] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.709383] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.709383] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.709764] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.710165] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.725475] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62 in Status: IN_PROGRESS for 2s [ 981.754984] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4be97761-0b55-45fd-ba63-8ef18d95b9f2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.793245] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.793341] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.794068] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.907111] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 in Status: SUCCESS [ 981.907435] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.907624] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.907863] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.908067] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.908192] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.908257] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.908409] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.908490] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.908587] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04a082fe-52f7-4ac6-a12b-63791c63be86',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.989771] env[70614]: INFO networking_nsxv3.common.synchronization [None req-4ecc2973-970d-44a8-9551-ffef913d3dc9 None None] Enqueued Resource ID: ae0a2dbe-3545-4a38-9293-486c71294732 with Priority: HIGHEST for action port [ 981.990599] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae0a2dbe-3545-4a38-9293-486c71294732 with Priority: HIGHEST for action port [ 981.994952] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-ae0a2dbe-3545-4a38-9293-486c71294732 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.994952] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ae0a2dbe-3545-4a38-9293-486c71294732" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.994952] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ae0a2dbe-3545-4a38-9293-486c71294732" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.994952] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ae0a2dbe-3545-4a38-9293-486c71294732" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.994952] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae0a2dbe-3545-4a38-9293-486c71294732',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.259101] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.259287] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.259337] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.259555] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.259643] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.259744] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4be97761-0b55-45fd-ba63-8ef18d95b9f2 is going to be updated. [ 982.294667] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.294861] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.294930] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.295146] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.295293] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.296868] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.307473] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4be97761-0b55-45fd-ba63-8ef18d95b9f2 in Status: IN_PROGRESS for 2s [ 982.413532] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('04a082fe-52f7-4ac6-a12b-63791c63be86',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.497809] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ae0a2dbe-3545-4a38-9293-486c71294732 [ 982.498118] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.498118] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.498118] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.498361] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.498412] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.498501] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ae0a2dbe-3545-4a38-9293-486c71294732 already deleted. [ 982.498579] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ae0a2dbe-3545-4a38-9293-486c71294732" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.734038] env[70614]: INFO networking_nsxv3.common.synchronization [req-d8aebb3d-c7b7-4a1c-94d2-174370dd0c34 req-de0bc3e2-adcb-404d-9a0f-a692f77cf196 tempest-MultipleCreateTestJSON-983295494 tempest-MultipleCreateTestJSON-983295494-project-member] Enqueued Resource ID: d141340f-d099-4b67-88b0-348423856ab2 with Priority: HIGHEST for action security_group_members [ 982.734731] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d141340f-d099-4b67-88b0-348423856ab2 with Priority: HIGHEST for action security_group_members [ 982.735397] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-d141340f-d099-4b67-88b0-348423856ab2 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.736427] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.736654] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.737118] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.737472] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.737713] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.737836] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.738083] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.738231] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.738610] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d141340f-d099-4b67-88b0-348423856ab2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.800551] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.800926] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.800926] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.801139] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.801139] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.801999] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 is going to be updated. [ 982.835793] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.838707] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.838707] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.838707] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.838707] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.849128] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 in Status: IN_PROGRESS for 2s [ 982.916566] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('04a082fe-52f7-4ac6-a12b-63791c63be86',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.244623] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.244833] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.244913] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.245171] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.245270] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.245798] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.245928] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.245969] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.246189] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.246319] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.246471] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d141340f-d099-4b67-88b0-348423856ab2 already deleted. [ 983.246624] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.366153] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-805 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.366432] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-805" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.366561] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-805" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.366963] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-805" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.367390] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.367576] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.367703] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.367938] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.368135] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.368342] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 983.368460] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 983.368571] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 983.368681] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 983.368791] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 983.368993] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 983.369079] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 983.388495] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 983.388671] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 983.390254] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 983.390254] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-805" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.390254] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-f09677e1-40aa-419b-9e18-4960c7841bf9 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.390254] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-f09677e1-40aa-419b-9e18-4960c7841bf9" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.390254] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-f09677e1-40aa-419b-9e18-4960c7841bf9" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.390254] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-f09677e1-40aa-419b-9e18-4960c7841bf9" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.393298] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f09677e1-40aa-419b-9e18-4960c7841bf9',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.422536] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.422772] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.422816] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.423039] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.423142] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.423240] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 is going to be updated. [ 983.460673] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.462835] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.462835] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.462835] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.462835] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.473562] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 in Status: IN_PROGRESS for 2s [ 983.739075] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62 in Status: SUCCESS [ 983.739277] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62 deletion is rescheduled due to dependency. [ 983.739429] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.776613] env[70614]: INFO networking_nsxv3.common.synchronization [None req-b6b933f9-3b69-4914-9a1a-b571222542d8 tempest-ServersTestFqdnHostnames-100799831 tempest-ServersTestFqdnHostnames-100799831-project-member] Enqueued Resource ID: dd5a38a7-babd-4c6b-b3a5-af13dd79865d with Priority: HIGHEST for action security_group_rules [ 983.777147] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd5a38a7-babd-4c6b-b3a5-af13dd79865d with Priority: HIGHEST for action security_group_rules [ 983.777454] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dd5a38a7-babd-4c6b-b3a5-af13dd79865d taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.777567] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dd5a38a7-babd-4c6b-b3a5-af13dd79865d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.777629] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dd5a38a7-babd-4c6b-b3a5-af13dd79865d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.777874] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dd5a38a7-babd-4c6b-b3a5-af13dd79865d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.777949] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dd5a38a7-babd-4c6b-b3a5-af13dd79865d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.895160] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.895470] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.895528] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.895791] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.895941] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.896138] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port f09677e1-40aa-419b-9e18-4960c7841bf9 not found, creating... [ 983.896385] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.896542] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.896703] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.896955] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.897122] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.897403] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.897556] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.897669] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.897871] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.897998] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.898822] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: f09677e1-40aa-419b-9e18-4960c7841bf9 is going to be created. [ 983.921552] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.922095] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.922264] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.922687] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.923571] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.923571] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-f09677e1-40aa-419b-9e18-4960c7841bf9" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.934049] env[70614]: INFO networking_nsxv3.common.synchronization [None req-8b85fe03-1bbd-4857-9d67-1cd9905fbb48 None None] Enqueued Resource ID: f6145c6f-cea7-403e-bbe0-b5b852042f6a with Priority: HIGHEST for action port [ 983.934301] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6145c6f-cea7-403e-bbe0-b5b852042f6a with Priority: HIGHEST for action port [ 983.934839] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-f6145c6f-cea7-403e-bbe0-b5b852042f6a taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.934954] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f6145c6f-cea7-403e-bbe0-b5b852042f6a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.935029] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f6145c6f-cea7-403e-bbe0-b5b852042f6a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.935499] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f6145c6f-cea7-403e-bbe0-b5b852042f6a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.936125] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6145c6f-cea7-403e-bbe0-b5b852042f6a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.984208] env[70614]: INFO networking_nsxv3.common.synchronization [None req-3013d2fd-c823-4db8-a64b-12c0da0e9eea tempest-ServersTestFqdnHostnames-100799831 tempest-ServersTestFqdnHostnames-100799831-project-member] Enqueued Resource ID: dd5a38a7-babd-4c6b-b3a5-af13dd79865d with Priority: HIGHEST for action security_group_rules [ 983.984876] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd5a38a7-babd-4c6b-b3a5-af13dd79865d with Priority: HIGHEST for action security_group_rules [ 983.985214] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dd5a38a7-babd-4c6b-b3a5-af13dd79865d taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.985312] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dd5a38a7-babd-4c6b-b3a5-af13dd79865d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.306196] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.306344] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.306488] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.306619] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.306705] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.306860] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dd5a38a7-babd-4c6b-b3a5-af13dd79865d already deleted. [ 984.306897] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dd5a38a7-babd-4c6b-b3a5-af13dd79865d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.307084] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dd5a38a7-babd-4c6b-b3a5-af13dd79865d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.307238] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dd5a38a7-babd-4c6b-b3a5-af13dd79865d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.307317] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dd5a38a7-babd-4c6b-b3a5-af13dd79865d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.318566] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4be97761-0b55-45fd-ba63-8ef18d95b9f2 in Status: SUCCESS [ 984.318566] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.438646] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f6145c6f-cea7-403e-bbe0-b5b852042f6a [ 984.438883] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.439025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.439121] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.439344] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.439436] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.439531] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f6145c6f-cea7-403e-bbe0-b5b852042f6a already deleted. [ 984.439613] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f6145c6f-cea7-403e-bbe0-b5b852042f6a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.555216] env[70614]: INFO networking_nsxv3.common.synchronization [None req-02163788-7e22-4323-b488-60fb06c2f8e6 None None] Enqueued Resource ID: 69f57ed9-1b96-4753-ba93-2a63421bced3 with Priority: HIGHEST for action port [ 984.555216] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69f57ed9-1b96-4753-ba93-2a63421bced3 with Priority: HIGHEST for action port [ 984.555216] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-69f57ed9-1b96-4753-ba93-2a63421bced3 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.555216] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-69f57ed9-1b96-4753-ba93-2a63421bced3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.555216] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-69f57ed9-1b96-4753-ba93-2a63421bced3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.555863] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-69f57ed9-1b96-4753-ba93-2a63421bced3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.555980] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('69f57ed9-1b96-4753-ba93-2a63421bced3',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.829779] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.830836] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.830836] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.830836] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.830836] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.830836] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dd5a38a7-babd-4c6b-b3a5-af13dd79865d already deleted. [ 984.830836] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dd5a38a7-babd-4c6b-b3a5-af13dd79865d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.861786] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 in Status: SUCCESS [ 984.862425] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.863341] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.863341] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.863554] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.863810] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.864287] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.864855] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.864855] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.865034] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.865987] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.865987] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.865987] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.865987] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.867146] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.867146] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.867146] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.867146] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.867146] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.867587] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.867780] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.059773] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 69f57ed9-1b96-4753-ba93-2a63421bced3 [ 985.061190] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.061190] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.061190] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.061190] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.061190] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.061190] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:69f57ed9-1b96-4753-ba93-2a63421bced3 already deleted. [ 985.061190] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-69f57ed9-1b96-4753-ba93-2a63421bced3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.267664] env[70614]: INFO networking_nsxv3.common.synchronization [req-d8aebb3d-c7b7-4a1c-94d2-174370dd0c34 req-1a241cdb-c8e7-4da1-b7d7-85d49c473bdb service nova] Enqueued Resource ID: d141340f-d099-4b67-88b0-348423856ab2 with Priority: HIGHEST for action security_group_rules [ 985.267664] env[70614]: INFO networking_nsxv3.common.synchronization [req-d8aebb3d-c7b7-4a1c-94d2-174370dd0c34 req-1a241cdb-c8e7-4da1-b7d7-85d49c473bdb service nova] Enqueued Resource ID: d141340f-d099-4b67-88b0-348423856ab2 with Priority: HIGHEST for action security_group_members [ 985.267664] env[70614]: INFO networking_nsxv3.common.synchronization [req-d8aebb3d-c7b7-4a1c-94d2-174370dd0c34 req-1a241cdb-c8e7-4da1-b7d7-85d49c473bdb service nova] Enqueued Resource ID: f09677e1-40aa-419b-9e18-4960c7841bf9 with Priority: HIGHEST for action port [ 985.267664] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d141340f-d099-4b67-88b0-348423856ab2 with Priority: HIGHEST for action security_group_rules [ 985.267664] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d141340f-d099-4b67-88b0-348423856ab2 with Priority: HIGHEST for action security_group_members [ 985.268139] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f09677e1-40aa-419b-9e18-4960c7841bf9 with Priority: HIGHEST for action port [ 985.268352] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d141340f-d099-4b67-88b0-348423856ab2 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.268498] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.268565] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.268827] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.268917] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d141340f-d099-4b67-88b0-348423856ab2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.272043] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-d141340f-d099-4b67-88b0-348423856ab2 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.272043] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.272043] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.272043] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.272043] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.272043] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.272043] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.273070] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.273725] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.273725] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d141340f-d099-4b67-88b0-348423856ab2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.274238] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-f09677e1-40aa-419b-9e18-4960c7841bf9 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.274354] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f09677e1-40aa-419b-9e18-4960c7841bf9" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.274408] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f09677e1-40aa-419b-9e18-4960c7841bf9" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.274569] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f09677e1-40aa-419b-9e18-4960c7841bf9" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.274638] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f09677e1-40aa-419b-9e18-4960c7841bf9',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.371435] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761: rpc.has_security_group_logging(os_id): False [ 985.393809] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.393809] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.393809] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.393809] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.393809] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.393809] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.393809] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.393809] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.393809] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.393809] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.393809] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.393809] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.393809] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.393809] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.393809] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.394373] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.394373] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.394373] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.394373] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.394373] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.394373] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 is going to be updated. [ 985.457466] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.457713] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.457713] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.458663] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.458663] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.477687] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 in Status: IN_PROGRESS for 2s [ 985.489559] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 in Status: SUCCESS [ 985.489794] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.489977] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.490253] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.490457] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.490663] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.490663] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.490786] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.490862] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.490945] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.491048] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('04a082fe-52f7-4ac6-a12b-63791c63be86',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.579027] env[70614]: INFO networking_nsxv3.common.synchronization [req-d8aebb3d-c7b7-4a1c-94d2-174370dd0c34 req-25d346f8-52e0-46b1-bc4c-b2d806bedbc1 tempest-MultipleCreateTestJSON-983295494 tempest-MultipleCreateTestJSON-983295494-project-member] Enqueued Resource ID: d141340f-d099-4b67-88b0-348423856ab2 with Priority: HIGHEST for action security_group_members [ 985.579615] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d141340f-d099-4b67-88b0-348423856ab2 with Priority: HIGHEST for action security_group_members [ 985.579910] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-d141340f-d099-4b67-88b0-348423856ab2 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.580014] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.778100] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-d141340f-d099-4b67-88b0-348423856ab2 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.778519] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.778915] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d141340f-d099-4b67-88b0-348423856ab2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.780477] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f09677e1-40aa-419b-9e18-4960c7841bf9 with status ACTIVE [ 985.780690] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.780821] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.780887] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.781582] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.781582] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.781582] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.781582] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.781582] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.781883] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.781883] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.783035] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.785496] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.785496] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.785496] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.785496] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.785496] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f09677e1-40aa-419b-9e18-4960c7841bf9 is going to be updated. [ 985.811048] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.811048] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.811048] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.811048] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.811048] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.811048] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f09677e1-40aa-419b-9e18-4960c7841bf9" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.996392] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-04a082fe-52f7-4ac6-a12b-63791c63be86 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.996656] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.996769] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.997079] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.997567] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.997881] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.997996] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.998289] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.999496] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.000128] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.000408] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-04a082fe-52f7-4ac6-a12b-63791c63be86 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.000576] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.000697] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.000941] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.001202] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.001438] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.001544] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.001721] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.001803] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.001896] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.001990] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('04a082fe-52f7-4ac6-a12b-63791c63be86',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.059019] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-805 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.059019] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-805" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.059019] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-805" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.059019] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-805" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.059019] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.059019] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.059019] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.059450] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.059450] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.059654] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 986.059776] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 986.060016] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 986.060016] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 986.060139] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 986.060252] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 986.060392] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 986.084372] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 986.084372] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 986.084372] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 986.084372] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-805" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.084372] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-5723d208-9b75-47b7-afdd-ff81a66d068f taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.084372] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-5723d208-9b75-47b7-afdd-ff81a66d068f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.084372] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-5723d208-9b75-47b7-afdd-ff81a66d068f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.084372] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-5723d208-9b75-47b7-afdd-ff81a66d068f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.084372] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5723d208-9b75-47b7-afdd-ff81a66d068f',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.280870] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d141340f-d099-4b67-88b0-348423856ab2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.508062] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 04a082fe-52f7-4ac6-a12b-63791c63be86: rpc.has_security_group_logging(os_id): False [ 986.530350] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.530525] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.532016] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.532016] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.532016] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.532016] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.532016] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.532016] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.532016] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.532016] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.532016] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.532380] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.532380] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.532515] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.532610] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.532850] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.532975] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.533056] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.533212] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.533285] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.533366] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 is going to be updated. [ 986.587184] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.587622] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.587622] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.587810] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.588542] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.588542] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 5723d208-9b75-47b7-afdd-ff81a66d068f not found, creating... [ 986.588542] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.588757] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.588757] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.588960] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.589144] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.590201] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.590201] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.590201] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.590328] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.590450] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.590590] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 5723d208-9b75-47b7-afdd-ff81a66d068f is going to be created. [ 986.605045] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.605045] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.605045] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.605311] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.605311] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.614035] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.614523] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.614523] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.614654] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.614904] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.615144] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-5723d208-9b75-47b7-afdd-ff81a66d068f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.622871] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 in Status: IN_PROGRESS for 2s [ 986.785701] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.785701] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.785701] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.785701] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.785701] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.785701] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d141340f-d099-4b67-88b0-348423856ab2 is going to be created. [ 986.831428] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.831683] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.831683] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.831894] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.832153] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.845218] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d141340f-d099-4b67-88b0-348423856ab2 in Status: UNINITIALIZED for 2s [ 987.292971] env[70614]: INFO networking_nsxv3.common.synchronization [None req-25357080-3762-4b27-82f5-2ecda63e3b96 None None] Enqueued Resource ID: 19757516-6a8d-47dc-841a-f89d39be2238 with Priority: HIGHEST for action port [ 987.293765] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19757516-6a8d-47dc-841a-f89d39be2238 with Priority: HIGHEST for action port [ 987.294272] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-19757516-6a8d-47dc-841a-f89d39be2238 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.298209] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-19757516-6a8d-47dc-841a-f89d39be2238" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.298324] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-19757516-6a8d-47dc-841a-f89d39be2238" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.298856] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-19757516-6a8d-47dc-841a-f89d39be2238" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.298856] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19757516-6a8d-47dc-841a-f89d39be2238',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.475608] env[70614]: INFO networking_nsxv3.common.synchronization [req-d8aebb3d-c7b7-4a1c-94d2-174370dd0c34 req-d907894a-bd9f-4967-9c3b-64f2eb514881 service nova] Enqueued Resource ID: d141340f-d099-4b67-88b0-348423856ab2 with Priority: HIGHEST for action security_group_rules [ 987.476031] env[70614]: INFO networking_nsxv3.common.synchronization [req-d8aebb3d-c7b7-4a1c-94d2-174370dd0c34 req-d907894a-bd9f-4967-9c3b-64f2eb514881 service nova] Enqueued Resource ID: d141340f-d099-4b67-88b0-348423856ab2 with Priority: HIGHEST for action security_group_members [ 987.476337] env[70614]: INFO networking_nsxv3.common.synchronization [req-d8aebb3d-c7b7-4a1c-94d2-174370dd0c34 req-d907894a-bd9f-4967-9c3b-64f2eb514881 service nova] Enqueued Resource ID: 5723d208-9b75-47b7-afdd-ff81a66d068f with Priority: HIGHEST for action port [ 987.477159] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d141340f-d099-4b67-88b0-348423856ab2 with Priority: HIGHEST for action security_group_rules [ 987.477490] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d141340f-d099-4b67-88b0-348423856ab2 with Priority: HIGHEST for action security_group_members [ 987.477793] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5723d208-9b75-47b7-afdd-ff81a66d068f with Priority: HIGHEST for action port [ 987.478235] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d141340f-d099-4b67-88b0-348423856ab2 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.480218] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.480218] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-d141340f-d099-4b67-88b0-348423856ab2 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.480218] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.483174] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-5723d208-9b75-47b7-afdd-ff81a66d068f taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.483174] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5723d208-9b75-47b7-afdd-ff81a66d068f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.483174] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5723d208-9b75-47b7-afdd-ff81a66d068f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.483174] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5723d208-9b75-47b7-afdd-ff81a66d068f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.483174] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5723d208-9b75-47b7-afdd-ff81a66d068f',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.503346] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 in Status: SUCCESS [ 987.503845] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.503845] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.504242] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.504242] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.802868] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 19757516-6a8d-47dc-841a-f89d39be2238 [ 987.804036] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.804236] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.804354] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.804621] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.804718] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.804831] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:19757516-6a8d-47dc-841a-f89d39be2238 already deleted. [ 987.805038] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-19757516-6a8d-47dc-841a-f89d39be2238" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.984988] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5723d208-9b75-47b7-afdd-ff81a66d068f with status ACTIVE [ 987.985251] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.985398] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.985461] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.985662] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.985748] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.985925] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.986033] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.986087] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.986227] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.986299] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.986518] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.986593] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.986641] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.986741] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.986807] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.986889] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5723d208-9b75-47b7-afdd-ff81a66d068f is going to be updated. [ 988.007293] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.009283] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.009283] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.009283] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.009283] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.009283] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.009283] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.009283] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.009283] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.009283] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.009283] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.016065] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.016210] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.016279] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.016518] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.016667] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.016831] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5723d208-9b75-47b7-afdd-ff81a66d068f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.043280] env[70614]: INFO networking_nsxv3.common.synchronization [None req-3b1817cb-21bb-4174-9153-5690d69837d9 None None] Enqueued Resource ID: 69499c22-dfae-4ccd-9d67-7a9d30ebec6c with Priority: HIGHEST for action port [ 988.043958] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69499c22-dfae-4ccd-9d67-7a9d30ebec6c with Priority: HIGHEST for action port [ 988.044298] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-69499c22-dfae-4ccd-9d67-7a9d30ebec6c taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.044425] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-69499c22-dfae-4ccd-9d67-7a9d30ebec6c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.044493] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-69499c22-dfae-4ccd-9d67-7a9d30ebec6c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.044758] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-69499c22-dfae-4ccd-9d67-7a9d30ebec6c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.044842] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('69499c22-dfae-4ccd-9d67-7a9d30ebec6c',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.336745] env[70614]: INFO networking_nsxv3.common.synchronization [req-d2a00fa0-5f47-482b-afb1-52e87e5570eb req-78b4a25c-8c0e-45d9-992e-847ecb486eeb tempest-ServersTestMultiNic-1290380047 tempest-ServersTestMultiNic-1290380047-project-member] Enqueued Resource ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 with Priority: HIGHEST for action security_group_members [ 988.337463] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 with Priority: HIGHEST for action security_group_members [ 988.337953] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.338141] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.338208] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.338444] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.338607] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.338711] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.338762] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.338902] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.338981] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.339147] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.511719] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.511719] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.550877] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 69499c22-dfae-4ccd-9d67-7a9d30ebec6c [ 988.551212] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.551281] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.551342] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.551567] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.551665] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.551769] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:69499c22-dfae-4ccd-9d67-7a9d30ebec6c already deleted. [ 988.551852] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-69499c22-dfae-4ccd-9d67-7a9d30ebec6c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.649777] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 in Status: SUCCESS [ 988.650443] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.738381] env[70614]: INFO networking_nsxv3.common.synchronization [req-d2a00fa0-5f47-482b-afb1-52e87e5570eb req-ba1997ba-4068-4c1f-abdd-fa84e34a1ca6 tempest-ServersTestMultiNic-1290380047 tempest-ServersTestMultiNic-1290380047-project-member] Enqueued Resource ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 with Priority: HIGHEST for action security_group_members [ 988.742022] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 with Priority: HIGHEST for action security_group_members [ 988.742022] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.742022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.844713] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.859997] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d141340f-d099-4b67-88b0-348423856ab2 in Status: SUCCESS [ 988.860315] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.860865] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.861119] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.861321] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.861514] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.861514] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.861700] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.861812] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.861886] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d141340f-d099-4b67-88b0-348423856ab2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.349073] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.365740] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d141340f-d099-4b67-88b0-348423856ab2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.851942] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.854966] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.854966] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.854966] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.854966] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.854966] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 is going to be updated. [ 989.868336] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d141340f-d099-4b67-88b0-348423856ab2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.916385] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.917036] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.917036] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.917036] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.917036] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.933036] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 in Status: IN_PROGRESS for 2s [ 990.372258] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.372635] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.372910] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.373225] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.373578] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.373807] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d141340f-d099-4b67-88b0-348423856ab2 is going to be updated. [ 990.408235] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.408475] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.408585] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.408708] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.408856] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.420406] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d141340f-d099-4b67-88b0-348423856ab2 in Status: IN_PROGRESS for 2s [ 990.733210] env[70614]: INFO networking_nsxv3.common.synchronization [None req-ee3ec5ac-10f4-4523-b419-f403697f5777 None None] Enqueued Resource ID: 778e55de-5544-4816-b693-2b474414ec06 with Priority: HIGHEST for action port [ 990.733910] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 778e55de-5544-4816-b693-2b474414ec06 with Priority: HIGHEST for action port [ 990.734512] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-778e55de-5544-4816-b693-2b474414ec06 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.734680] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-778e55de-5544-4816-b693-2b474414ec06" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.734769] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-778e55de-5544-4816-b693-2b474414ec06" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.735142] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-778e55de-5544-4816-b693-2b474414ec06" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.735305] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('778e55de-5544-4816-b693-2b474414ec06',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.238234] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 778e55de-5544-4816-b693-2b474414ec06 [ 991.239046] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.239046] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.239046] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.239292] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.239292] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.239420] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:778e55de-5544-4816-b693-2b474414ec06 already deleted. [ 991.239480] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-778e55de-5544-4816-b693-2b474414ec06" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.949519] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 in Status: SUCCESS [ 991.949825] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.949899] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.950144] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.950355] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.950474] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.950536] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.950758] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.950758] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.950829] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.951184] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.951184] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.951184] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.951330] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.951390] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.951510] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.951556] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.951655] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.951722] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.951796] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.951878] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.952774] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.954880] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.954880] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.954880] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.954880] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.954880] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.954880] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.954880] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.434607] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d141340f-d099-4b67-88b0-348423856ab2 in Status: SUCCESS [ 992.434833] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.435024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.435297] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.435748] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.435748] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.435748] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.435921] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.435921] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.436074] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.436116] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d141340f-d099-4b67-88b0-348423856ab2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.437053] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.437226] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.437392] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.437557] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.437618] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.438079] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.438079] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.438079] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d141340f-d099-4b67-88b0-348423856ab2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.455738] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761: rpc.has_security_group_logging(os_id): False [ 992.457089] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.457253] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.457320] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.457544] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.457673] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.457880] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.458027] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.458137] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.458325] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.458400] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.458515] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 is going to be updated. [ 992.487261] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.487261] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.487261] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.487261] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.487261] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.487261] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.487261] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.487769] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.487769] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.487769] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.487769] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.487992] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.487992] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.488102] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.488102] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.488283] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.488390] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.488446] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.488553] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.488614] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.488696] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 is going to be updated. [ 992.493812] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.494024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.494024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.494183] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.494317] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.517697] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 in Status: IN_PROGRESS for 2s [ 992.593031] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.593031] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.593031] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.593031] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.593031] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.617753] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 in Status: IN_PROGRESS for 2s [ 992.942025] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-d141340f-d099-4b67-88b0-348423856ab2 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.942025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.942025] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d141340f-d099-4b67-88b0-348423856ab2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.370765] env[70614]: INFO networking_nsxv3.common.synchronization [req-d68296a3-6a7f-468e-ba55-3d39a4ba7b3d req-ad7b1eca-5418-4199-a4ea-8ef301b7cc98 tempest-AttachInterfacesTestJSON-1919943007 tempest-AttachInterfacesTestJSON-1919943007-project-member] Enqueued Resource ID: ca55d9c7-11be-476b-bdb5-63e4c956a4de with Priority: HIGHEST for action security_group_members [ 993.371429] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca55d9c7-11be-476b-bdb5-63e4c956a4de with Priority: HIGHEST for action security_group_members [ 993.371762] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca55d9c7-11be-476b-bdb5-63e4c956a4de taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.371894] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca55d9c7-11be-476b-bdb5-63e4c956a4de" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.371957] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca55d9c7-11be-476b-bdb5-63e4c956a4de" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.377132] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca55d9c7-11be-476b-bdb5-63e4c956a4de" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.377330] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.377458] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.377527] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.377714] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.377796] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.377897] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca55d9c7-11be-476b-bdb5-63e4c956a4de',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.446411] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d141340f-d099-4b67-88b0-348423856ab2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.867446] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-385 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.867719] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-385" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.867856] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-385" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.868149] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-385" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.868995] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.868995] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.868995] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.869251] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.869464] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.869766] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 993.869872] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 993.870022] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 993.872210] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 993.872210] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 993.872210] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 993.872210] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 993.882190] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.882190] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.882190] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.882190] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.882190] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.882190] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.882190] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.882190] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.882190] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.882190] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.882190] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca55d9c7-11be-476b-bdb5-63e4c956a4de already deleted. [ 993.882190] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca55d9c7-11be-476b-bdb5-63e4c956a4de" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.895898] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 993.895898] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 993.895898] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 993.895898] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-385" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.895898] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-2a2e3fb5-127b-4c26-b990-81eb65944cbe taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.895898] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-2a2e3fb5-127b-4c26-b990-81eb65944cbe" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.895898] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-2a2e3fb5-127b-4c26-b990-81eb65944cbe" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.895898] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-2a2e3fb5-127b-4c26-b990-81eb65944cbe" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.895898] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a2e3fb5-127b-4c26-b990-81eb65944cbe',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.951892] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.951892] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.951892] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.951892] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.951892] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.951892] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d141340f-d099-4b67-88b0-348423856ab2 is going to be updated. [ 993.985714] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.985714] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.985714] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.985714] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.985714] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.998173] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d141340f-d099-4b67-88b0-348423856ab2 in Status: IN_PROGRESS for 2s [ 994.399831] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.400147] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.400147] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.400460] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.400553] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.400713] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 2a2e3fb5-127b-4c26-b990-81eb65944cbe not found, creating... [ 994.400976] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.401145] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.401264] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.401486] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.401621] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.401906] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.406635] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.406635] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.406635] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.406635] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.406635] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 2a2e3fb5-127b-4c26-b990-81eb65944cbe is going to be created. [ 994.436015] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.436247] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.436376] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.436656] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.436886] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.437147] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-2a2e3fb5-127b-4c26-b990-81eb65944cbe" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.531480] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 in Status: SUCCESS [ 994.531629] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 deletion is rescheduled due to dependency. [ 994.531676] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.643857] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 in Status: SUCCESS [ 994.644188] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.255222] env[70614]: INFO networking_nsxv3.common.synchronization [req-d68296a3-6a7f-468e-ba55-3d39a4ba7b3d req-edc582e1-fe63-4147-ae95-6436888981e4 service nova] Enqueued Resource ID: ca55d9c7-11be-476b-bdb5-63e4c956a4de with Priority: HIGHEST for action security_group_rules [ 995.255416] env[70614]: INFO networking_nsxv3.common.synchronization [req-d68296a3-6a7f-468e-ba55-3d39a4ba7b3d req-edc582e1-fe63-4147-ae95-6436888981e4 service nova] Enqueued Resource ID: ca55d9c7-11be-476b-bdb5-63e4c956a4de with Priority: HIGHEST for action security_group_members [ 995.255571] env[70614]: INFO networking_nsxv3.common.synchronization [req-d68296a3-6a7f-468e-ba55-3d39a4ba7b3d req-edc582e1-fe63-4147-ae95-6436888981e4 service nova] Enqueued Resource ID: 2a2e3fb5-127b-4c26-b990-81eb65944cbe with Priority: HIGHEST for action port [ 995.256280] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca55d9c7-11be-476b-bdb5-63e4c956a4de with Priority: HIGHEST for action security_group_rules [ 995.256418] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca55d9c7-11be-476b-bdb5-63e4c956a4de with Priority: HIGHEST for action security_group_members [ 995.256529] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a2e3fb5-127b-4c26-b990-81eb65944cbe with Priority: HIGHEST for action port [ 995.256818] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca55d9c7-11be-476b-bdb5-63e4c956a4de taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.256975] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca55d9c7-11be-476b-bdb5-63e4c956a4de" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.257057] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca55d9c7-11be-476b-bdb5-63e4c956a4de" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.257348] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca55d9c7-11be-476b-bdb5-63e4c956a4de" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.257439] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca55d9c7-11be-476b-bdb5-63e4c956a4de',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.258320] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca55d9c7-11be-476b-bdb5-63e4c956a4de taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.258498] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca55d9c7-11be-476b-bdb5-63e4c956a4de" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.258595] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca55d9c7-11be-476b-bdb5-63e4c956a4de" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.258700] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca55d9c7-11be-476b-bdb5-63e4c956a4de" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.259627] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.259627] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.259627] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.259627] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.259627] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.259627] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca55d9c7-11be-476b-bdb5-63e4c956a4de',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.260278] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-2a2e3fb5-127b-4c26-b990-81eb65944cbe taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.260775] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2a2e3fb5-127b-4c26-b990-81eb65944cbe" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.260851] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2a2e3fb5-127b-4c26-b990-81eb65944cbe" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.261017] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2a2e3fb5-127b-4c26-b990-81eb65944cbe" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.261098] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a2e3fb5-127b-4c26-b990-81eb65944cbe',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.763141] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca55d9c7-11be-476b-bdb5-63e4c956a4de',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.764730] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca55d9c7-11be-476b-bdb5-63e4c956a4de taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.764880] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca55d9c7-11be-476b-bdb5-63e4c956a4de" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.765110] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2a2e3fb5-127b-4c26-b990-81eb65944cbe with status ACTIVE [ 995.769077] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.769077] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.769077] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.769077] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.769077] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.769077] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.769077] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.769077] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.769077] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.769077] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.769077] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.769077] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.769077] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.769077] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.769077] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.769077] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2a2e3fb5-127b-4c26-b990-81eb65944cbe is going to be updated. [ 995.795355] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.795475] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.795571] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.795866] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.796107] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.796346] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2a2e3fb5-127b-4c26-b990-81eb65944cbe" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.008968] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d141340f-d099-4b67-88b0-348423856ab2 in Status: SUCCESS [ 996.008968] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.008968] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.008968] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.008968] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.008968] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.009373] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.009373] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.009373] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.009373] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.009716] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-d141340f-d099-4b67-88b0-348423856ab2 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.009716] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.009716] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.009871] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.009943] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.010983] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.010983] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.010983] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.010983] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.010983] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.010983] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d141340f-d099-4b67-88b0-348423856ab2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.271188] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca55d9c7-11be-476b-bdb5-63e4c956a4de',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.518209] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d141340f-d099-4b67-88b0-348423856ab2: rpc.has_security_group_logging(os_id): False [ 996.538113] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.538388] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.538388] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.538555] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.538662] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.538836] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.538954] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.539054] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.539188] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.539188] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.539470] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.539566] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.539619] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.540037] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.540037] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.540037] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.540307] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.540307] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.540307] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.540475] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.540475] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d141340f-d099-4b67-88b0-348423856ab2 is going to be created. [ 996.617923] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.618090] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.618090] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.618382] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.618561] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.633334] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d141340f-d099-4b67-88b0-348423856ab2 in Status: IN_PROGRESS for 2s [ 996.773605] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.774072] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.774072] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.774072] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.774244] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.774298] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca55d9c7-11be-476b-bdb5-63e4c956a4de is going to be created. [ 996.812147] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.812255] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.812327] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.812546] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.812699] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.824808] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca55d9c7-11be-476b-bdb5-63e4c956a4de in Status: UNINITIALIZED for 2s [ 998.040031] env[70614]: INFO networking_nsxv3.common.synchronization [None req-50f7c508-2b69-447c-872a-48d460fb7aac None None] Enqueued Resource ID: b787a2b8-0bd6-4c9e-9a37-b50d0b3a114f with Priority: HIGHEST for action port [ 998.040031] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b787a2b8-0bd6-4c9e-9a37-b50d0b3a114f with Priority: HIGHEST for action port [ 998.040674] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-b787a2b8-0bd6-4c9e-9a37-b50d0b3a114f taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.040784] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b787a2b8-0bd6-4c9e-9a37-b50d0b3a114f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.040819] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b787a2b8-0bd6-4c9e-9a37-b50d0b3a114f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.041070] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b787a2b8-0bd6-4c9e-9a37-b50d0b3a114f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.041156] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b787a2b8-0bd6-4c9e-9a37-b50d0b3a114f',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.543386] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b787a2b8-0bd6-4c9e-9a37-b50d0b3a114f [ 998.543907] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.543907] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.543907] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.546149] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.546149] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.546149] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b787a2b8-0bd6-4c9e-9a37-b50d0b3a114f already deleted. [ 998.546149] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b787a2b8-0bd6-4c9e-9a37-b50d0b3a114f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.649653] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d141340f-d099-4b67-88b0-348423856ab2 in Status: SUCCESS [ 998.649653] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.649851] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.649990] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.650115] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d141340f-d099-4b67-88b0-348423856ab2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.838511] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca55d9c7-11be-476b-bdb5-63e4c956a4de in Status: SUCCESS [ 998.839500] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca55d9c7-11be-476b-bdb5-63e4c956a4de" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.839500] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca55d9c7-11be-476b-bdb5-63e4c956a4de" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.839500] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca55d9c7-11be-476b-bdb5-63e4c956a4de" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.839500] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.839751] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.839751] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.839853] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.839967] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.840151] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca55d9c7-11be-476b-bdb5-63e4c956a4de" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.840225] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ca55d9c7-11be-476b-bdb5-63e4c956a4de',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.155388] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-d141340f-d099-4b67-88b0-348423856ab2 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.155388] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.155388] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.155870] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.155870] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.155870] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.155987] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.156715] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.156715] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.156715] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.156715] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d141340f-d099-4b67-88b0-348423856ab2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.344344] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ca55d9c7-11be-476b-bdb5-63e4c956a4de',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.659290] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-d141340f-d099-4b67-88b0-348423856ab2 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.659611] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.659770] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.660121] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.660331] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.660503] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.660557] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.660685] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.660771] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.660852] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.661017] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-d141340f-d099-4b67-88b0-348423856ab2 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.661106] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.661172] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.661294] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.661422] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.661511] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.661580] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.661732] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.661809] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.661885] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.662020] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d141340f-d099-4b67-88b0-348423856ab2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.849059] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ca55d9c7-11be-476b-bdb5-63e4c956a4de: rpc.has_security_group_logging(os_id): False [ 999.880531] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.880947] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.881170] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.881488] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.881676] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.882133] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.882410] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.883778] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.884114] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.884312] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.884502] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca55d9c7-11be-476b-bdb5-63e4c956a4de is going to be created. [ 1000.089038] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.089216] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.089374] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.089548] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.089736] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.105720] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca55d9c7-11be-476b-bdb5-63e4c956a4de in Status: IN_PROGRESS for 2s [ 1000.168758] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d141340f-d099-4b67-88b0-348423856ab2: rpc.has_security_group_logging(os_id): False [ 1000.199263] env[70614]: INFO networking_nsxv3.common.synchronization [None req-c0cf5c7b-f5b1-494a-89e5-409558eff1fa None None] Enqueued Resource ID: a1434eb8-b244-48b1-9458-72ffdf9958e6 with Priority: HIGHEST for action port [ 1000.199702] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1434eb8-b244-48b1-9458-72ffdf9958e6 with Priority: HIGHEST for action port [ 1000.200319] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-a1434eb8-b244-48b1-9458-72ffdf9958e6 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.200450] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a1434eb8-b244-48b1-9458-72ffdf9958e6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.200604] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a1434eb8-b244-48b1-9458-72ffdf9958e6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.200756] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a1434eb8-b244-48b1-9458-72ffdf9958e6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.200835] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1434eb8-b244-48b1-9458-72ffdf9958e6',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.206026] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.206147] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.206189] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.206378] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.206470] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.206817] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.206901] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.206942] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.207200] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.207279] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.207507] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.207610] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.207855] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.207855] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.207948] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.208128] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.208302] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.208302] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.208425] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.208515] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.208603] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d141340f-d099-4b67-88b0-348423856ab2 is going to be updated. [ 1000.269674] env[70614]: INFO networking_nsxv3.common.synchronization [req-e449fad6-f49d-47dc-84b3-77b0c6c97eb0 req-087e8326-b40c-418c-a070-31f85cdc2c49 tempest-ServerActionsTestOtherB-1079543702 tempest-ServerActionsTestOtherB-1079543702-project-member] Enqueued Resource ID: 4e54f39e-349d-49ad-bb07-348488d846f0 with Priority: HIGHEST for action security_group_members [ 1000.270354] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e54f39e-349d-49ad-bb07-348488d846f0 with Priority: HIGHEST for action security_group_members [ 1000.270712] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e54f39e-349d-49ad-bb07-348488d846f0 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.270922] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.270971] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.271216] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.271412] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.271662] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.271714] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.271886] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.272118] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.272118] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e54f39e-349d-49ad-bb07-348488d846f0',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.325316] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.325458] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.325526] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.325728] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.325872] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.344893] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d141340f-d099-4b67-88b0-348423856ab2 in Status: IN_PROGRESS for 2s [ 1000.712473] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a1434eb8-b244-48b1-9458-72ffdf9958e6 [ 1000.714779] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.714779] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.714779] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.714779] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.714779] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.714779] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a1434eb8-b244-48b1-9458-72ffdf9958e6 already deleted. [ 1000.714779] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a1434eb8-b244-48b1-9458-72ffdf9958e6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.778801] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.779030] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.779125] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.779397] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.779492] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.779707] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.780113] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.780113] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.780113] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.780113] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.780273] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e54f39e-349d-49ad-bb07-348488d846f0 is going to be updated. [ 1000.811011] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.811156] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.811224] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.811437] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.815026] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.822875] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e54f39e-349d-49ad-bb07-348488d846f0 in Status: IN_PROGRESS for 2s [ 1000.886476] env[70614]: INFO networking_nsxv3.common.synchronization [req-61b578c0-0776-4796-b68f-f81739d385a5 req-6547df8f-9c7f-44b2-a1cb-840d11db9203 tempest-MultipleCreateTestJSON-983295494 tempest-MultipleCreateTestJSON-983295494-project-member] Enqueued Resource ID: d141340f-d099-4b67-88b0-348423856ab2 with Priority: HIGHEST for action security_group_members [ 1000.887717] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d141340f-d099-4b67-88b0-348423856ab2 with Priority: HIGHEST for action security_group_members [ 1000.887717] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-d141340f-d099-4b67-88b0-348423856ab2 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.887717] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.887717] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.887893] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.887926] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.888650] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.891147] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.891371] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.891471] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.891581] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d141340f-d099-4b67-88b0-348423856ab2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.115374] env[70614]: INFO networking_nsxv3.common.synchronization [req-8358b3be-1506-416c-931e-9bfbe72400e4 req-3bc3c6e6-840b-4d3d-85f6-5e8fe63fb1fb tempest-MultipleCreateTestJSON-983295494 tempest-MultipleCreateTestJSON-983295494-project-member] Enqueued Resource ID: d141340f-d099-4b67-88b0-348423856ab2 with Priority: HIGHEST for action security_group_members [ 1001.115501] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d141340f-d099-4b67-88b0-348423856ab2 with Priority: HIGHEST for action security_group_members [ 1001.115745] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-d141340f-d099-4b67-88b0-348423856ab2 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.115849] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.397451] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d141340f-d099-4b67-88b0-348423856ab2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.901655] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d141340f-d099-4b67-88b0-348423856ab2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.119633] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca55d9c7-11be-476b-bdb5-63e4c956a4de in Status: SUCCESS [ 1002.119852] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca55d9c7-11be-476b-bdb5-63e4c956a4de" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.147039] env[70614]: INFO networking_nsxv3.common.synchronization [req-8fe243ce-b3ba-4cc1-a011-959e903d53a3 req-e90c7a71-4daf-4976-9ee2-43531df6e8f9 tempest-ImagesTestJSON-1765947257 tempest-ImagesTestJSON-1765947257-project-member] Enqueued Resource ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 with Priority: HIGHEST for action security_group_members [ 1002.147579] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 with Priority: HIGHEST for action security_group_members [ 1002.147888] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-04a082fe-52f7-4ac6-a12b-63791c63be86 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.148041] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.148123] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.148310] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.148474] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.148566] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.148625] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.148776] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.148859] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.148956] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04a082fe-52f7-4ac6-a12b-63791c63be86',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.357161] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d141340f-d099-4b67-88b0-348423856ab2 in Status: SUCCESS [ 1002.357406] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.387907] env[70614]: INFO networking_nsxv3.common.synchronization [req-7f886134-c972-4221-a61f-a2c27aeafda7 req-02b4c75d-cccf-4b42-87b2-1b3d1803d858 tempest-AttachInterfacesUnderV243Test-10932585 tempest-AttachInterfacesUnderV243Test-10932585-project-member] Enqueued Resource ID: e744e9f1-b15c-4958-bd6f-1c34e15652a8 with Priority: HIGHEST for action security_group_members [ 1002.387907] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e744e9f1-b15c-4958-bd6f-1c34e15652a8 with Priority: HIGHEST for action security_group_members [ 1002.387907] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-e744e9f1-b15c-4958-bd6f-1c34e15652a8 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.387907] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e744e9f1-b15c-4958-bd6f-1c34e15652a8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.387907] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e744e9f1-b15c-4958-bd6f-1c34e15652a8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.388267] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e744e9f1-b15c-4958-bd6f-1c34e15652a8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.388267] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.389295] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.389295] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.389295] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.389295] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.389295] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e744e9f1-b15c-4958-bd6f-1c34e15652a8',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.403876] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.404227] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.404227] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.404708] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.404708] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.404708] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d141340f-d099-4b67-88b0-348423856ab2 is going to be updated. [ 1002.434386] env[70614]: INFO networking_nsxv3.common.synchronization [req-7f886134-c972-4221-a61f-a2c27aeafda7 req-02b4c75d-cccf-4b42-87b2-1b3d1803d858 tempest-AttachInterfacesUnderV243Test-10932585 tempest-AttachInterfacesUnderV243Test-10932585-project-member] Enqueued Resource ID: e744e9f1-b15c-4958-bd6f-1c34e15652a8 with Priority: HIGHEST for action security_group_rules [ 1002.434477] env[70614]: INFO networking_nsxv3.common.synchronization [req-7f886134-c972-4221-a61f-a2c27aeafda7 req-02b4c75d-cccf-4b42-87b2-1b3d1803d858 tempest-AttachInterfacesUnderV243Test-10932585 tempest-AttachInterfacesUnderV243Test-10932585-project-member] Enqueued Resource ID: e744e9f1-b15c-4958-bd6f-1c34e15652a8 with Priority: HIGHEST for action security_group_members [ 1002.434584] env[70614]: INFO networking_nsxv3.common.synchronization [req-7f886134-c972-4221-a61f-a2c27aeafda7 req-02b4c75d-cccf-4b42-87b2-1b3d1803d858 tempest-AttachInterfacesUnderV243Test-10932585 tempest-AttachInterfacesUnderV243Test-10932585-project-member] Enqueued Resource ID: 39e7649e-b82e-48aa-9542-c7c252eff660 with Priority: HIGHEST for action port [ 1002.436660] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.436775] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.436846] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.437124] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.437233] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.438907] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e744e9f1-b15c-4958-bd6f-1c34e15652a8 with Priority: HIGHEST for action security_group_rules [ 1002.439037] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e744e9f1-b15c-4958-bd6f-1c34e15652a8 with Priority: HIGHEST for action security_group_members [ 1002.439144] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39e7649e-b82e-48aa-9542-c7c252eff660 with Priority: HIGHEST for action port [ 1002.440241] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e744e9f1-b15c-4958-bd6f-1c34e15652a8 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.440241] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e744e9f1-b15c-4958-bd6f-1c34e15652a8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.440241] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e744e9f1-b15c-4958-bd6f-1c34e15652a8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.440241] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e744e9f1-b15c-4958-bd6f-1c34e15652a8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.440241] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e744e9f1-b15c-4958-bd6f-1c34e15652a8',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.445575] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-e744e9f1-b15c-4958-bd6f-1c34e15652a8 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.445575] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e744e9f1-b15c-4958-bd6f-1c34e15652a8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.445766] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-39e7649e-b82e-48aa-9542-c7c252eff660 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.445884] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-39e7649e-b82e-48aa-9542-c7c252eff660" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.445918] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-39e7649e-b82e-48aa-9542-c7c252eff660" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.446128] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-39e7649e-b82e-48aa-9542-c7c252eff660" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.446213] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39e7649e-b82e-48aa-9542-c7c252eff660',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.455446] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d141340f-d099-4b67-88b0-348423856ab2 in Status: IN_PROGRESS for 2s [ 1002.655556] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('04a082fe-52f7-4ac6-a12b-63791c63be86',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.833473] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e54f39e-349d-49ad-bb07-348488d846f0 in Status: SUCCESS [ 1002.833678] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e54f39e-349d-49ad-bb07-348488d846f0 deletion is rescheduled due to dependency. [ 1002.833797] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.896047] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e744e9f1-b15c-4958-bd6f-1c34e15652a8',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.948383] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-e744e9f1-b15c-4958-bd6f-1c34e15652a8 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.948521] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e744e9f1-b15c-4958-bd6f-1c34e15652a8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.952968] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 39e7649e-b82e-48aa-9542-c7c252eff660 with status ACTIVE [ 1002.953206] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.953343] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.953411] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.953623] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.953714] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.953889] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.953983] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.954055] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.954207] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.954285] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.954544] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.954544] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.954645] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.954786] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.954835] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.954876] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 39e7649e-b82e-48aa-9542-c7c252eff660 is going to be updated. [ 1002.975509] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.975683] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.975721] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.975912] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.976060] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.976388] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-39e7649e-b82e-48aa-9542-c7c252eff660" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.160658] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('04a082fe-52f7-4ac6-a12b-63791c63be86',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.398020] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e744e9f1-b15c-4958-bd6f-1c34e15652a8',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.662951] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.662951] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.662951] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.662951] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.662951] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.662951] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 is going to be updated. [ 1003.697671] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.697794] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.697833] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.698092] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.698228] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.709875] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 in Status: IN_PROGRESS for 2s [ 1003.903740] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.903902] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.904024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.904324] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.904463] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.904604] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e744e9f1-b15c-4958-bd6f-1c34e15652a8 is going to be updated. [ 1003.940347] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.940347] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.940347] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.940499] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.940643] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.952084] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e744e9f1-b15c-4958-bd6f-1c34e15652a8 in Status: IN_PROGRESS for 2s [ 1004.468687] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d141340f-d099-4b67-88b0-348423856ab2 in Status: SUCCESS [ 1004.468936] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.469151] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.469472] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.469684] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.469890] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.470014] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.474863] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.474863] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.474863] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d141340f-d099-4b67-88b0-348423856ab2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.977845] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.978197] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.978197] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.978476] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.978578] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.978841] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.978961] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.979029] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.979241] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.979315] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.980162] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d141340f-d099-4b67-88b0-348423856ab2 is going to be updated. [ 1005.006397] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.006974] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.007744] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.007979] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.008146] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.023523] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d141340f-d099-4b67-88b0-348423856ab2 in Status: IN_PROGRESS for 2s [ 1005.744690] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 in Status: SUCCESS [ 1005.745012] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.906792] env[70614]: INFO networking_nsxv3.common.synchronization [req-6432e0ac-713d-42ae-970d-3866a20e134e req-b3047b41-abcc-4637-b57a-786b5b883950 tempest-AttachInterfacesUnderV243Test-10932585 tempest-AttachInterfacesUnderV243Test-10932585-project-member] Enqueued Resource ID: e744e9f1-b15c-4958-bd6f-1c34e15652a8 with Priority: HIGHEST for action security_group_members [ 1005.907629] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e744e9f1-b15c-4958-bd6f-1c34e15652a8 with Priority: HIGHEST for action security_group_members [ 1005.907733] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-e744e9f1-b15c-4958-bd6f-1c34e15652a8 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.907827] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e744e9f1-b15c-4958-bd6f-1c34e15652a8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.933377] env[70614]: INFO networking_nsxv3.common.synchronization [req-6432e0ac-713d-42ae-970d-3866a20e134e req-b3047b41-abcc-4637-b57a-786b5b883950 tempest-AttachInterfacesUnderV243Test-10932585 tempest-AttachInterfacesUnderV243Test-10932585-project-member] Enqueued Resource ID: e744e9f1-b15c-4958-bd6f-1c34e15652a8 with Priority: HIGHEST for action security_group_rules [ 1005.933560] env[70614]: INFO networking_nsxv3.common.synchronization [req-6432e0ac-713d-42ae-970d-3866a20e134e req-b3047b41-abcc-4637-b57a-786b5b883950 tempest-AttachInterfacesUnderV243Test-10932585 tempest-AttachInterfacesUnderV243Test-10932585-project-member] Enqueued Resource ID: e744e9f1-b15c-4958-bd6f-1c34e15652a8 with Priority: HIGHEST for action security_group_members [ 1005.933702] env[70614]: INFO networking_nsxv3.common.synchronization [req-6432e0ac-713d-42ae-970d-3866a20e134e req-b3047b41-abcc-4637-b57a-786b5b883950 tempest-AttachInterfacesUnderV243Test-10932585 tempest-AttachInterfacesUnderV243Test-10932585-project-member] Enqueued Resource ID: 39e7649e-b82e-48aa-9542-c7c252eff660 with Priority: HIGHEST for action port [ 1005.935792] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e744e9f1-b15c-4958-bd6f-1c34e15652a8 with Priority: HIGHEST for action security_group_rules [ 1005.935792] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e744e9f1-b15c-4958-bd6f-1c34e15652a8 with Priority: HIGHEST for action security_group_members [ 1005.935792] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39e7649e-b82e-48aa-9542-c7c252eff660 with Priority: HIGHEST for action port [ 1005.935792] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e744e9f1-b15c-4958-bd6f-1c34e15652a8 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.935792] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e744e9f1-b15c-4958-bd6f-1c34e15652a8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.935792] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-e744e9f1-b15c-4958-bd6f-1c34e15652a8 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.935792] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e744e9f1-b15c-4958-bd6f-1c34e15652a8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.935792] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-39e7649e-b82e-48aa-9542-c7c252eff660 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.935792] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-39e7649e-b82e-48aa-9542-c7c252eff660" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.935792] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-39e7649e-b82e-48aa-9542-c7c252eff660" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.935792] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-39e7649e-b82e-48aa-9542-c7c252eff660" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.936190] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39e7649e-b82e-48aa-9542-c7c252eff660',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.964072] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e744e9f1-b15c-4958-bd6f-1c34e15652a8 in Status: SUCCESS [ 1005.964404] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e744e9f1-b15c-4958-bd6f-1c34e15652a8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.964492] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e744e9f1-b15c-4958-bd6f-1c34e15652a8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.964719] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e744e9f1-b15c-4958-bd6f-1c34e15652a8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.964904] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.965030] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.965117] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.965262] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.965320] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.965417] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e744e9f1-b15c-4958-bd6f-1c34e15652a8',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.439474] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 39e7649e-b82e-48aa-9542-c7c252eff660 with status ACTIVE [ 1006.439811] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.439927] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.439927] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.440117] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.440655] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.440655] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.440655] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.440941] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.440941] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.440941] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.441123] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.441220] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.441274] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.441422] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.441500] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.441583] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 39e7649e-b82e-48aa-9542-c7c252eff660 is going to be updated. [ 1006.464084] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.464084] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.464084] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.464446] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.464446] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.464528] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-39e7649e-b82e-48aa-9542-c7c252eff660" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.468726] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e744e9f1-b15c-4958-bd6f-1c34e15652a8',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.970784] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e744e9f1-b15c-4958-bd6f-1c34e15652a8',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.036730] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d141340f-d099-4b67-88b0-348423856ab2 in Status: SUCCESS [ 1007.037879] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d141340f-d099-4b67-88b0-348423856ab2 deletion is rescheduled due to dependency. [ 1007.037879] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.326634] env[70614]: INFO networking_nsxv3.common.synchronization [req-4a8709ec-ab0e-450c-b1f5-dcb87741f36c req-d2149381-4cd2-4cae-922d-a31cc9b89012 tempest-ServerActionsTestOtherA-302418031 tempest-ServerActionsTestOtherA-302418031-project-member] Enqueued Resource ID: ad8b8cdd-7eee-48c2-8c33-7b83fde75038 with Priority: HIGHEST for action security_group_members [ 1007.327186] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad8b8cdd-7eee-48c2-8c33-7b83fde75038 with Priority: HIGHEST for action security_group_members [ 1007.332173] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad8b8cdd-7eee-48c2-8c33-7b83fde75038 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.332328] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad8b8cdd-7eee-48c2-8c33-7b83fde75038" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.332398] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad8b8cdd-7eee-48c2-8c33-7b83fde75038" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.332666] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad8b8cdd-7eee-48c2-8c33-7b83fde75038" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.332889] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.332951] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.333616] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.333616] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.333616] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.333616] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad8b8cdd-7eee-48c2-8c33-7b83fde75038',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.477015] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.477015] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.481128] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.481128] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.481128] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.481128] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e744e9f1-b15c-4958-bd6f-1c34e15652a8 is going to be updated. [ 1007.517049] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.518870] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.519264] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.520259] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.520259] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.534068] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e744e9f1-b15c-4958-bd6f-1c34e15652a8 in Status: IN_PROGRESS for 2s [ 1007.642313] env[70614]: INFO networking_nsxv3.common.synchronization [None req-894e1829-86e1-4c7b-af99-65b3056533cc None None] Enqueued Resource ID: 7cc85bfc-bd91-4304-9cb4-d6ac342375da with Priority: HIGHEST for action port [ 1007.642867] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cc85bfc-bd91-4304-9cb4-d6ac342375da with Priority: HIGHEST for action port [ 1007.643239] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-7cc85bfc-bd91-4304-9cb4-d6ac342375da taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.643346] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7cc85bfc-bd91-4304-9cb4-d6ac342375da" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.643419] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7cc85bfc-bd91-4304-9cb4-d6ac342375da" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.643632] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7cc85bfc-bd91-4304-9cb4-d6ac342375da" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.643749] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7cc85bfc-bd91-4304-9cb4-d6ac342375da',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.839585] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.840767] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.840767] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.840767] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.840767] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.840767] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.841088] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.841088] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.841300] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.841345] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.841460] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad8b8cdd-7eee-48c2-8c33-7b83fde75038 already deleted. [ 1007.841606] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad8b8cdd-7eee-48c2-8c33-7b83fde75038" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.144790] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-367 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.144937] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-367" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.145020] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-367" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.145863] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-367" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.147090] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.147090] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.147090] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.147865] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.147979] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.148206] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1008.148360] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1008.148503] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1008.148647] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1008.148796] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1008.148949] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1008.149136] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1008.150689] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7cc85bfc-bd91-4304-9cb4-d6ac342375da [ 1008.151224] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.152311] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.152556] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.152709] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.152834] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.152968] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7cc85bfc-bd91-4304-9cb4-d6ac342375da already deleted. [ 1008.153092] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7cc85bfc-bd91-4304-9cb4-d6ac342375da" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.212318] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1008.212318] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.063 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1008.212318] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1008.212566] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-367" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.212881] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-fd4e37ee-62a3-489c-bba7-cfa2015c27e5 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.212881] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-fd4e37ee-62a3-489c-bba7-cfa2015c27e5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.213068] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-fd4e37ee-62a3-489c-bba7-cfa2015c27e5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.213353] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-fd4e37ee-62a3-489c-bba7-cfa2015c27e5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.213493] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd4e37ee-62a3-489c-bba7-cfa2015c27e5',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.716131] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.716641] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.716641] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.716871] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.717076] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.717347] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port fd4e37ee-62a3-489c-bba7-cfa2015c27e5 not found, creating... [ 1008.717702] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.717923] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.718041] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.718298] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.718469] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.718812] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.719018] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.719172] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.719672] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.719917] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.720108] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: fd4e37ee-62a3-489c-bba7-cfa2015c27e5 is going to be created. [ 1008.790401] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.790692] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.790795] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.791251] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.791548] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.791861] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-fd4e37ee-62a3-489c-bba7-cfa2015c27e5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.546449] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e744e9f1-b15c-4958-bd6f-1c34e15652a8 in Status: SUCCESS [ 1009.546687] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e744e9f1-b15c-4958-bd6f-1c34e15652a8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.546860] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e744e9f1-b15c-4958-bd6f-1c34e15652a8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.547190] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e744e9f1-b15c-4958-bd6f-1c34e15652a8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.547380] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.547584] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.547584] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.547738] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.547813] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.548057] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e744e9f1-b15c-4958-bd6f-1c34e15652a8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.548057] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e744e9f1-b15c-4958-bd6f-1c34e15652a8',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.548925] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e744e9f1-b15c-4958-bd6f-1c34e15652a8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.549124] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e744e9f1-b15c-4958-bd6f-1c34e15652a8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.549304] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.549434] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.549488] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.549626] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.549706] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.549791] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e744e9f1-b15c-4958-bd6f-1c34e15652a8',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.828663] env[70614]: INFO networking_nsxv3.common.synchronization [req-253c68a5-fb2a-476a-872c-de5126e89715 req-e998226c-9858-4846-945e-dd55775bbd2f tempest-ServersTestFqdnHostnames-100799831 tempest-ServersTestFqdnHostnames-100799831-project-member] Enqueued Resource ID: dd5a38a7-babd-4c6b-b3a5-af13dd79865d with Priority: HIGHEST for action security_group_members [ 1009.829452] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd5a38a7-babd-4c6b-b3a5-af13dd79865d with Priority: HIGHEST for action security_group_members [ 1009.829814] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd5a38a7-babd-4c6b-b3a5-af13dd79865d taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.829959] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd5a38a7-babd-4c6b-b3a5-af13dd79865d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.830045] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd5a38a7-babd-4c6b-b3a5-af13dd79865d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.830406] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd5a38a7-babd-4c6b-b3a5-af13dd79865d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.830610] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.830751] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.830819] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.831065] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.831185] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.831296] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd5a38a7-babd-4c6b-b3a5-af13dd79865d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.877177] env[70614]: INFO networking_nsxv3.common.synchronization [req-4a8709ec-ab0e-450c-b1f5-dcb87741f36c req-dcdb0bfa-5583-486b-bbc7-867b75904cc5 service nova] Enqueued Resource ID: ad8b8cdd-7eee-48c2-8c33-7b83fde75038 with Priority: HIGHEST for action security_group_rules [ 1009.877177] env[70614]: INFO networking_nsxv3.common.synchronization [req-4a8709ec-ab0e-450c-b1f5-dcb87741f36c req-dcdb0bfa-5583-486b-bbc7-867b75904cc5 service nova] Enqueued Resource ID: ad8b8cdd-7eee-48c2-8c33-7b83fde75038 with Priority: HIGHEST for action security_group_members [ 1009.877177] env[70614]: INFO networking_nsxv3.common.synchronization [req-4a8709ec-ab0e-450c-b1f5-dcb87741f36c req-dcdb0bfa-5583-486b-bbc7-867b75904cc5 service nova] Enqueued Resource ID: fd4e37ee-62a3-489c-bba7-cfa2015c27e5 with Priority: HIGHEST for action port [ 1009.877177] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad8b8cdd-7eee-48c2-8c33-7b83fde75038 with Priority: HIGHEST for action security_group_rules [ 1009.877177] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad8b8cdd-7eee-48c2-8c33-7b83fde75038 with Priority: HIGHEST for action security_group_members [ 1009.877177] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd4e37ee-62a3-489c-bba7-cfa2015c27e5 with Priority: HIGHEST for action port [ 1009.877851] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad8b8cdd-7eee-48c2-8c33-7b83fde75038 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.878142] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad8b8cdd-7eee-48c2-8c33-7b83fde75038" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.878420] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad8b8cdd-7eee-48c2-8c33-7b83fde75038" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.879040] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad8b8cdd-7eee-48c2-8c33-7b83fde75038" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.879266] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad8b8cdd-7eee-48c2-8c33-7b83fde75038',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.880780] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad8b8cdd-7eee-48c2-8c33-7b83fde75038 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.880780] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad8b8cdd-7eee-48c2-8c33-7b83fde75038" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.880780] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad8b8cdd-7eee-48c2-8c33-7b83fde75038" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.880974] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad8b8cdd-7eee-48c2-8c33-7b83fde75038" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.881127] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.881223] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.881284] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.881425] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.881509] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.881601] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad8b8cdd-7eee-48c2-8c33-7b83fde75038',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.886110] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-fd4e37ee-62a3-489c-bba7-cfa2015c27e5 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.886110] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fd4e37ee-62a3-489c-bba7-cfa2015c27e5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.886110] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fd4e37ee-62a3-489c-bba7-cfa2015c27e5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.886110] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fd4e37ee-62a3-489c-bba7-cfa2015c27e5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.886110] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd4e37ee-62a3-489c-bba7-cfa2015c27e5',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.053689] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e744e9f1-b15c-4958-bd6f-1c34e15652a8',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.053689] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e744e9f1-b15c-4958-bd6f-1c34e15652a8',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.210707] env[70614]: INFO networking_nsxv3.common.synchronization [None req-9404ba32-1fcc-48cf-a9bb-5fe1027d73e3 None None] Enqueued Resource ID: ec5fa56a-c1df-41f8-9729-491b41d18e0b with Priority: HIGHEST for action port [ 1010.211253] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec5fa56a-c1df-41f8-9729-491b41d18e0b with Priority: HIGHEST for action port [ 1010.211980] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-ec5fa56a-c1df-41f8-9729-491b41d18e0b taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.211980] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ec5fa56a-c1df-41f8-9729-491b41d18e0b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.211980] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ec5fa56a-c1df-41f8-9729-491b41d18e0b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.214536] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ec5fa56a-c1df-41f8-9729-491b41d18e0b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.214671] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec5fa56a-c1df-41f8-9729-491b41d18e0b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.336079] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.336281] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.336550] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.336550] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.336860] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.336860] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.336944] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.336975] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.337147] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.337241] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.337327] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd5a38a7-babd-4c6b-b3a5-af13dd79865d already deleted. [ 1010.337407] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd5a38a7-babd-4c6b-b3a5-af13dd79865d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.385924] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad8b8cdd-7eee-48c2-8c33-7b83fde75038 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.386066] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad8b8cdd-7eee-48c2-8c33-7b83fde75038" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.389619] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ad8b8cdd-7eee-48c2-8c33-7b83fde75038',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.390819] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fd4e37ee-62a3-489c-bba7-cfa2015c27e5 with status ACTIVE [ 1010.391074] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.391773] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.391773] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.391773] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.391773] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.391966] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.392086] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.392149] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.392347] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.392426] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.392703] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.392703] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.392838] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.392925] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.392975] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.399864] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fd4e37ee-62a3-489c-bba7-cfa2015c27e5 is going to be updated. [ 1010.428679] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.428679] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.428679] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.428679] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.428679] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.428679] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fd4e37ee-62a3-489c-bba7-cfa2015c27e5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.478323] env[70614]: INFO networking_nsxv3.common.synchronization [req-b465ee56-555f-4c56-8c4c-10601f5a8809 req-af6089f4-15e7-4b26-98b1-4f374c2406a6 tempest-AttachInterfacesUnderV243Test-10932585 tempest-AttachInterfacesUnderV243Test-10932585-project-member] Enqueued Resource ID: e744e9f1-b15c-4958-bd6f-1c34e15652a8 with Priority: HIGHEST for action security_group_members [ 1010.478788] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e744e9f1-b15c-4958-bd6f-1c34e15652a8 with Priority: HIGHEST for action security_group_members [ 1010.479258] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-e744e9f1-b15c-4958-bd6f-1c34e15652a8 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.479790] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e744e9f1-b15c-4958-bd6f-1c34e15652a8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.555612] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e744e9f1-b15c-4958-bd6f-1c34e15652a8',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.557147] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e744e9f1-b15c-4958-bd6f-1c34e15652a8: rpc.has_security_group_logging(os_id): False [ 1010.580270] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.580692] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.580692] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.580813] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.580854] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.581133] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.581236] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.581296] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.581449] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.581513] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.581597] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e744e9f1-b15c-4958-bd6f-1c34e15652a8 is going to be updated. [ 1010.605357] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-472 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.605357] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-472" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.605357] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-472" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.606331] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-472" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.606496] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.606848] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.607167] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.607633] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.607898] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.608236] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1010.608455] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1010.608653] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1010.608845] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1010.609082] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1010.610018] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1010.610018] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1010.643305] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1010.643756] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1010.644230] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1010.644531] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-472" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.645285] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-5e42a713-0631-4a3f-945f-c602c8a8fd9f taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.645285] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-5e42a713-0631-4a3f-945f-c602c8a8fd9f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.645465] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-5e42a713-0631-4a3f-945f-c602c8a8fd9f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.645845] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-5e42a713-0631-4a3f-945f-c602c8a8fd9f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.646036] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e42a713-0631-4a3f-945f-c602c8a8fd9f',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.663496] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.663693] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.663776] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.664573] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.664573] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.676136] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e744e9f1-b15c-4958-bd6f-1c34e15652a8 in Status: IN_PROGRESS for 2s [ 1010.719634] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ec5fa56a-c1df-41f8-9729-491b41d18e0b [ 1010.719998] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.719998] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.719998] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.720600] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.720600] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.720600] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ec5fa56a-c1df-41f8-9729-491b41d18e0b already deleted. [ 1010.720600] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ec5fa56a-c1df-41f8-9729-491b41d18e0b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.904279] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ad8b8cdd-7eee-48c2-8c33-7b83fde75038',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.063523] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.063523] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.063523] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.063523] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.063523] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.063523] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e744e9f1-b15c-4958-bd6f-1c34e15652a8 is going to be updated. [ 1011.102324] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.102565] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.102669] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.102924] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.104406] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.115202] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e744e9f1-b15c-4958-bd6f-1c34e15652a8 in Status: IN_PROGRESS for 2s [ 1011.153056] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.153542] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.153625] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.153968] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.154668] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.154896] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 5e42a713-0631-4a3f-945f-c602c8a8fd9f not found, creating... [ 1011.155339] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.155582] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.155752] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.156085] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.156300] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.156689] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.157359] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.157547] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.157835] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.158057] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.158266] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 5e42a713-0631-4a3f-945f-c602c8a8fd9f is going to be created. [ 1011.205819] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.206056] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.207673] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.208034] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.208353] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.208617] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-5e42a713-0631-4a3f-945f-c602c8a8fd9f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.404635] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.404635] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.404757] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.404898] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.404988] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.405110] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad8b8cdd-7eee-48c2-8c33-7b83fde75038 is going to be created. [ 1011.494017] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.494174] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.494254] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.494573] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.494958] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.516986] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad8b8cdd-7eee-48c2-8c33-7b83fde75038 in Status: UNINITIALIZED for 2s [ 1012.224023] env[70614]: INFO networking_nsxv3.common.synchronization [req-253c68a5-fb2a-476a-872c-de5126e89715 req-57821943-5544-4821-981e-23e8225626c0 service nova] Enqueued Resource ID: dd5a38a7-babd-4c6b-b3a5-af13dd79865d with Priority: HIGHEST for action security_group_rules [ 1012.224023] env[70614]: INFO networking_nsxv3.common.synchronization [req-253c68a5-fb2a-476a-872c-de5126e89715 req-57821943-5544-4821-981e-23e8225626c0 service nova] Enqueued Resource ID: dd5a38a7-babd-4c6b-b3a5-af13dd79865d with Priority: HIGHEST for action security_group_members [ 1012.224023] env[70614]: INFO networking_nsxv3.common.synchronization [req-253c68a5-fb2a-476a-872c-de5126e89715 req-57821943-5544-4821-981e-23e8225626c0 service nova] Enqueued Resource ID: 5e42a713-0631-4a3f-945f-c602c8a8fd9f with Priority: HIGHEST for action port [ 1012.224023] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd5a38a7-babd-4c6b-b3a5-af13dd79865d with Priority: HIGHEST for action security_group_rules [ 1012.228022] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd5a38a7-babd-4c6b-b3a5-af13dd79865d with Priority: HIGHEST for action security_group_members [ 1012.228022] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e42a713-0631-4a3f-945f-c602c8a8fd9f with Priority: HIGHEST for action port [ 1012.228022] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dd5a38a7-babd-4c6b-b3a5-af13dd79865d taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.228022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dd5a38a7-babd-4c6b-b3a5-af13dd79865d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.228022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dd5a38a7-babd-4c6b-b3a5-af13dd79865d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.228022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dd5a38a7-babd-4c6b-b3a5-af13dd79865d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.228022] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dd5a38a7-babd-4c6b-b3a5-af13dd79865d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.228022] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd5a38a7-babd-4c6b-b3a5-af13dd79865d taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.228022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd5a38a7-babd-4c6b-b3a5-af13dd79865d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.228022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd5a38a7-babd-4c6b-b3a5-af13dd79865d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.228022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd5a38a7-babd-4c6b-b3a5-af13dd79865d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.228022] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.228855] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.229052] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.229357] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.229549] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.229740] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd5a38a7-babd-4c6b-b3a5-af13dd79865d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.231298] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-5e42a713-0631-4a3f-945f-c602c8a8fd9f taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.231586] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5e42a713-0631-4a3f-945f-c602c8a8fd9f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.231811] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5e42a713-0631-4a3f-945f-c602c8a8fd9f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.232090] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5e42a713-0631-4a3f-945f-c602c8a8fd9f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.232281] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e42a713-0631-4a3f-945f-c602c8a8fd9f',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.623525] env[70614]: INFO networking_nsxv3.common.synchronization [None req-3e0e6e3a-8e4f-4705-8b14-d67ed3f6914f None None] Enqueued Resource ID: be958bae-cb58-4397-8ce0-ed813ca8ec33 with Priority: HIGHEST for action port [ 1012.623976] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be958bae-cb58-4397-8ce0-ed813ca8ec33 with Priority: HIGHEST for action port [ 1012.624397] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-be958bae-cb58-4397-8ce0-ed813ca8ec33 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.624556] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-be958bae-cb58-4397-8ce0-ed813ca8ec33" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.624556] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-be958bae-cb58-4397-8ce0-ed813ca8ec33" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.624761] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-be958bae-cb58-4397-8ce0-ed813ca8ec33" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.624839] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be958bae-cb58-4397-8ce0-ed813ca8ec33',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.693438] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e744e9f1-b15c-4958-bd6f-1c34e15652a8 in Status: SUCCESS [ 1012.693698] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e744e9f1-b15c-4958-bd6f-1c34e15652a8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.693894] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e744e9f1-b15c-4958-bd6f-1c34e15652a8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.694152] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e744e9f1-b15c-4958-bd6f-1c34e15652a8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.694265] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e744e9f1-b15c-4958-bd6f-1c34e15652a8',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.734709] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dd5a38a7-babd-4c6b-b3a5-af13dd79865d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.737197] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd5a38a7-babd-4c6b-b3a5-af13dd79865d taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.737310] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd5a38a7-babd-4c6b-b3a5-af13dd79865d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.737467] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5e42a713-0631-4a3f-945f-c602c8a8fd9f with status ACTIVE [ 1012.737626] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.737733] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.737797] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.738272] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.738313] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.738493] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.738602] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.741132] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.741132] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.741132] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.741132] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.741132] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.741132] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.741132] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.741132] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.741132] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5e42a713-0631-4a3f-945f-c602c8a8fd9f is going to be updated. [ 1012.768191] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.768351] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.768410] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.768611] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.768749] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.768914] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5e42a713-0631-4a3f-945f-c602c8a8fd9f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.128030] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port be958bae-cb58-4397-8ce0-ed813ca8ec33 [ 1013.128030] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.128030] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.128030] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.128438] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.128438] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.128438] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:be958bae-cb58-4397-8ce0-ed813ca8ec33 already deleted. [ 1013.128438] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-be958bae-cb58-4397-8ce0-ed813ca8ec33" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.129335] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e744e9f1-b15c-4958-bd6f-1c34e15652a8 in Status: SUCCESS [ 1013.129580] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e744e9f1-b15c-4958-bd6f-1c34e15652a8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.129728] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e744e9f1-b15c-4958-bd6f-1c34e15652a8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.129904] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e744e9f1-b15c-4958-bd6f-1c34e15652a8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.130085] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.130193] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.131117] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.131117] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.131117] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.131117] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e744e9f1-b15c-4958-bd6f-1c34e15652a8',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.224480] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.225718] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.225718] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.225718] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.225718] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.225718] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e744e9f1-b15c-4958-bd6f-1c34e15652a8 is going to be deleted. [ 1013.241029] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dd5a38a7-babd-4c6b-b3a5-af13dd79865d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.297986] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.299793] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.299793] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.299949] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.299994] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.300281] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e744e9f1-b15c-4958-bd6f-1c34e15652a8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.524909] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad8b8cdd-7eee-48c2-8c33-7b83fde75038 in Status: SUCCESS [ 1013.525072] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad8b8cdd-7eee-48c2-8c33-7b83fde75038" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.525262] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad8b8cdd-7eee-48c2-8c33-7b83fde75038" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.525483] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad8b8cdd-7eee-48c2-8c33-7b83fde75038" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.525672] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.525789] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.525855] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.526045] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.526186] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.526296] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad8b8cdd-7eee-48c2-8c33-7b83fde75038" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.526448] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ad8b8cdd-7eee-48c2-8c33-7b83fde75038',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.634761] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.634928] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.635010] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.635251] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.635884] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.635884] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.635884] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.635884] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.635884] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.636150] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.636150] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e744e9f1-b15c-4958-bd6f-1c34e15652a8 is going to be deleted. [ 1013.675854] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.676175] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.676175] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.676447] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.676567] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.676874] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e744e9f1-b15c-4958-bd6f-1c34e15652a8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.676999] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e744e9f1-b15c-4958-bd6f-1c34e15652a8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.677133] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e744e9f1-b15c-4958-bd6f-1c34e15652a8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.677426] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.677587] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.677672] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.677857] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.677940] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.678043] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e744e9f1-b15c-4958-bd6f-1c34e15652a8',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.743226] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.743377] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.743451] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.743655] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.743743] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.743849] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd5a38a7-babd-4c6b-b3a5-af13dd79865d is going to be created. [ 1013.781536] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.781682] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.781751] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.781956] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.782130] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.794265] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd5a38a7-babd-4c6b-b3a5-af13dd79865d in Status: UNINITIALIZED for 2s [ 1014.028674] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad8b8cdd-7eee-48c2-8c33-7b83fde75038 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.028841] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad8b8cdd-7eee-48c2-8c33-7b83fde75038" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.028917] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad8b8cdd-7eee-48c2-8c33-7b83fde75038" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.029298] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad8b8cdd-7eee-48c2-8c33-7b83fde75038" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.029524] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.029680] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.029754] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.029931] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.030038] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.030222] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad8b8cdd-7eee-48c2-8c33-7b83fde75038" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.030319] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad8b8cdd-7eee-48c2-8c33-7b83fde75038 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.030458] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad8b8cdd-7eee-48c2-8c33-7b83fde75038" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.030553] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad8b8cdd-7eee-48c2-8c33-7b83fde75038" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.030739] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad8b8cdd-7eee-48c2-8c33-7b83fde75038" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.030890] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.030986] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.031059] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.031199] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.031276] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.031358] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad8b8cdd-7eee-48c2-8c33-7b83fde75038" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.031472] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ad8b8cdd-7eee-48c2-8c33-7b83fde75038',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.183321] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.183566] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.183697] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.184090] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.184244] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.184584] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.184821] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.184860] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.185158] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.185299] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.185460] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e744e9f1-b15c-4958-bd6f-1c34e15652a8 already deleted. [ 1014.185610] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e744e9f1-b15c-4958-bd6f-1c34e15652a8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.523226] env[70614]: INFO networking_nsxv3.common.synchronization [req-bfee0e27-8c94-4aef-b165-4fefc67aec43 req-906c54a2-4394-42e3-b5ef-470da8094b14 tempest-ServersNegativeTestMultiTenantJSON-874674398 tempest-ServersNegativeTestMultiTenantJSON-874674398-project-member] Enqueued Resource ID: b55beff3-0092-4844-958f-ed6f6ef8b108 with Priority: HIGHEST for action security_group_members [ 1014.523817] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b55beff3-0092-4844-958f-ed6f6ef8b108 with Priority: HIGHEST for action security_group_members [ 1014.524130] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-b55beff3-0092-4844-958f-ed6f6ef8b108 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.524271] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b55beff3-0092-4844-958f-ed6f6ef8b108" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.524362] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b55beff3-0092-4844-958f-ed6f6ef8b108" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.528178] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b55beff3-0092-4844-958f-ed6f6ef8b108" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.528178] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.528178] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.528178] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.528178] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.528455] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.528455] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b55beff3-0092-4844-958f-ed6f6ef8b108',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.539395] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ad8b8cdd-7eee-48c2-8c33-7b83fde75038: rpc.has_security_group_logging(os_id): False [ 1014.561671] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.561871] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.561871] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.562134] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.562222] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.562445] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.562554] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.562614] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.562749] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.562821] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.564525] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.564525] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.564750] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.564955] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.565059] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.565271] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.565370] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.565988] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.565988] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.565988] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.565988] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad8b8cdd-7eee-48c2-8c33-7b83fde75038 is going to be created. [ 1014.653846] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.654138] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.654138] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.654341] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.654535] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.668317] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad8b8cdd-7eee-48c2-8c33-7b83fde75038 in Status: IN_PROGRESS for 2s [ 1015.031686] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.031853] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.032158] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.032158] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.032262] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.032468] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.032588] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.032626] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.032753] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.032830] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.032911] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b55beff3-0092-4844-958f-ed6f6ef8b108 already deleted. [ 1015.032995] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b55beff3-0092-4844-958f-ed6f6ef8b108" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.272009] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-86 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.272245] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.272431] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.272896] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.277137] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.277568] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.277728] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.279167] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.279580] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.279893] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1015.280071] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1015.280519] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1015.280519] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1015.280519] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1015.280891] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1015.280949] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1015.307641] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1015.307851] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1015.308009] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1015.308228] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.308572] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-b41fce3c-ebbc-4777-a2c7-a89ccb8bd2b6 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.308774] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-b41fce3c-ebbc-4777-a2c7-a89ccb8bd2b6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.308898] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-b41fce3c-ebbc-4777-a2c7-a89ccb8bd2b6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.309332] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-b41fce3c-ebbc-4777-a2c7-a89ccb8bd2b6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.309514] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b41fce3c-ebbc-4777-a2c7-a89ccb8bd2b6',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.467246] env[70614]: INFO networking_nsxv3.common.synchronization [None req-5304003e-48ee-44b7-81c9-a6947c75b896 None None] Enqueued Resource ID: e3780b90-5550-43a1-bb0f-2c9a465b7085 with Priority: HIGHEST for action port [ 1015.467246] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3780b90-5550-43a1-bb0f-2c9a465b7085 with Priority: HIGHEST for action port [ 1015.467246] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-e3780b90-5550-43a1-bb0f-2c9a465b7085 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.467246] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e3780b90-5550-43a1-bb0f-2c9a465b7085" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.467246] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e3780b90-5550-43a1-bb0f-2c9a465b7085" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.467246] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e3780b90-5550-43a1-bb0f-2c9a465b7085" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.467246] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3780b90-5550-43a1-bb0f-2c9a465b7085',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.807529] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd5a38a7-babd-4c6b-b3a5-af13dd79865d in Status: SUCCESS [ 1015.808365] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd5a38a7-babd-4c6b-b3a5-af13dd79865d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.808632] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd5a38a7-babd-4c6b-b3a5-af13dd79865d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.809062] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd5a38a7-babd-4c6b-b3a5-af13dd79865d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.809392] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.809522] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.809522] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.809685] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.809774] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.809862] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd5a38a7-babd-4c6b-b3a5-af13dd79865d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.809954] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dd5a38a7-babd-4c6b-b3a5-af13dd79865d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.812235] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.812571] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.812812] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.813210] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.813483] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.813885] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port b41fce3c-ebbc-4777-a2c7-a89ccb8bd2b6 not found, creating... [ 1015.814488] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.815020] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.815261] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.815766] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.816566] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.816566] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.816703] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.817150] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.817674] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.817937] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.818314] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: b41fce3c-ebbc-4777-a2c7-a89ccb8bd2b6 is going to be created. [ 1015.847270] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.847544] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.847676] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.848034] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.848260] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.848509] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-b41fce3c-ebbc-4777-a2c7-a89ccb8bd2b6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.972776] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e3780b90-5550-43a1-bb0f-2c9a465b7085 [ 1015.973193] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.973193] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.973423] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.973617] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.973617] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.973684] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e3780b90-5550-43a1-bb0f-2c9a465b7085 already deleted. [ 1015.973745] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e3780b90-5550-43a1-bb0f-2c9a465b7085" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.322045] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dd5a38a7-babd-4c6b-b3a5-af13dd79865d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.717616] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad8b8cdd-7eee-48c2-8c33-7b83fde75038 in Status: SUCCESS [ 1016.718311] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad8b8cdd-7eee-48c2-8c33-7b83fde75038" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.783447] env[70614]: INFO networking_nsxv3.common.synchronization [req-0adf0cf3-0874-4b79-8148-5a8b4515b32a req-6ec16e3b-82f2-4b08-a578-2f43bee46e8d tempest-DeleteServersTestJSON-1690139659 tempest-DeleteServersTestJSON-1690139659-project-member] Enqueued Resource ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f with Priority: HIGHEST for action security_group_members [ 1016.784197] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f with Priority: HIGHEST for action security_group_members [ 1016.784509] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.784639] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.787037] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.787037] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.787037] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.787037] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.787037] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.787037] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.787037] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.787037] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df8f20f5-6e92-4ac4-bdd2-05863ac4905f',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.819647] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dd5a38a7-babd-4c6b-b3a5-af13dd79865d: rpc.has_security_group_logging(os_id): False [ 1016.840808] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.840948] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.841079] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.841490] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.841490] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.842987] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.843141] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.843246] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.843363] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.843450] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.843682] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dd5a38a7-babd-4c6b-b3a5-af13dd79865d is going to be created. [ 1016.932701] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.932701] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.932701] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.932701] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.933197] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.953852] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd5a38a7-babd-4c6b-b3a5-af13dd79865d in Status: IN_PROGRESS for 2s [ 1017.072072] env[70614]: INFO networking_nsxv3.common.synchronization [req-bfee0e27-8c94-4aef-b165-4fefc67aec43 req-faae2887-c173-4b37-8bc9-45082bc5215c service nova] Enqueued Resource ID: b55beff3-0092-4844-958f-ed6f6ef8b108 with Priority: HIGHEST for action security_group_rules [ 1017.072277] env[70614]: INFO networking_nsxv3.common.synchronization [req-bfee0e27-8c94-4aef-b165-4fefc67aec43 req-faae2887-c173-4b37-8bc9-45082bc5215c service nova] Enqueued Resource ID: b55beff3-0092-4844-958f-ed6f6ef8b108 with Priority: HIGHEST for action security_group_members [ 1017.072420] env[70614]: INFO networking_nsxv3.common.synchronization [req-bfee0e27-8c94-4aef-b165-4fefc67aec43 req-faae2887-c173-4b37-8bc9-45082bc5215c service nova] Enqueued Resource ID: b41fce3c-ebbc-4777-a2c7-a89ccb8bd2b6 with Priority: HIGHEST for action port [ 1017.072820] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b55beff3-0092-4844-958f-ed6f6ef8b108 with Priority: HIGHEST for action security_group_rules [ 1017.072820] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b55beff3-0092-4844-958f-ed6f6ef8b108 with Priority: HIGHEST for action security_group_members [ 1017.072929] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b41fce3c-ebbc-4777-a2c7-a89ccb8bd2b6 with Priority: HIGHEST for action port [ 1017.073459] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b55beff3-0092-4844-958f-ed6f6ef8b108 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.073623] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b55beff3-0092-4844-958f-ed6f6ef8b108" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.073690] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b55beff3-0092-4844-958f-ed6f6ef8b108" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.079505] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b55beff3-0092-4844-958f-ed6f6ef8b108" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.079603] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b55beff3-0092-4844-958f-ed6f6ef8b108',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.080956] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-b55beff3-0092-4844-958f-ed6f6ef8b108 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.081094] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b55beff3-0092-4844-958f-ed6f6ef8b108" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.081155] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b55beff3-0092-4844-958f-ed6f6ef8b108" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.081343] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b55beff3-0092-4844-958f-ed6f6ef8b108" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.081504] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.081605] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.081664] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.081804] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.081887] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.081976] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b55beff3-0092-4844-958f-ed6f6ef8b108',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.082766] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-b41fce3c-ebbc-4777-a2c7-a89ccb8bd2b6 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.082901] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b41fce3c-ebbc-4777-a2c7-a89ccb8bd2b6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.082938] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b41fce3c-ebbc-4777-a2c7-a89ccb8bd2b6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.083904] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b41fce3c-ebbc-4777-a2c7-a89ccb8bd2b6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.083979] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b41fce3c-ebbc-4777-a2c7-a89ccb8bd2b6',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.291647] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.291849] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.291907] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.292156] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.292251] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.292450] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.292550] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.292615] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.292813] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.292946] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.292946] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f is going to be updated. [ 1017.320834] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.321012] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.321081] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.321271] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.321412] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.335909] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f in Status: IN_PROGRESS for 2s [ 1017.478198] env[70614]: INFO networking_nsxv3.common.synchronization [None req-d2b58178-9507-429d-b355-e66f9dac8e13 tempest-ServersTestBootFromVolume-917450361 tempest-ServersTestBootFromVolume-917450361-project-member] Enqueued Resource ID: 45904912-7759-4b89-83ba-2a95c86ca5fd with Priority: HIGHEST for action security_group_rules [ 1017.478787] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45904912-7759-4b89-83ba-2a95c86ca5fd with Priority: HIGHEST for action security_group_rules [ 1017.479098] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45904912-7759-4b89-83ba-2a95c86ca5fd taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.479313] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45904912-7759-4b89-83ba-2a95c86ca5fd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.479313] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45904912-7759-4b89-83ba-2a95c86ca5fd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.479576] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45904912-7759-4b89-83ba-2a95c86ca5fd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.479644] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45904912-7759-4b89-83ba-2a95c86ca5fd',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.487491] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-707 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.487620] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-707" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.489683] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-707" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.489683] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-707" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.489683] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.489683] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.491305] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.492284] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.492284] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.492284] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1017.492284] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1017.492798] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1017.494205] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1017.494205] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1017.494205] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1017.494205] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1017.513768] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1017.513960] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1017.514118] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1017.514299] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-707" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.514620] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-bb06fe20-5d3c-4255-9b67-d1281dcd60df taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.514792] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-bb06fe20-5d3c-4255-9b67-d1281dcd60df" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.514912] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-bb06fe20-5d3c-4255-9b67-d1281dcd60df" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.515276] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-bb06fe20-5d3c-4255-9b67-d1281dcd60df" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.515472] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb06fe20-5d3c-4255-9b67-d1281dcd60df',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.563817] env[70614]: INFO networking_nsxv3.common.synchronization [None req-3a1724a4-93bf-4294-bce4-5302b258e7fe tempest-ServersTestBootFromVolume-917450361 tempest-ServersTestBootFromVolume-917450361-project-member] Enqueued Resource ID: 45904912-7759-4b89-83ba-2a95c86ca5fd with Priority: HIGHEST for action security_group_rules [ 1017.564686] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45904912-7759-4b89-83ba-2a95c86ca5fd with Priority: HIGHEST for action security_group_rules [ 1017.565087] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45904912-7759-4b89-83ba-2a95c86ca5fd taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.565171] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45904912-7759-4b89-83ba-2a95c86ca5fd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.585768] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-b55beff3-0092-4844-958f-ed6f6ef8b108 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.585949] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b55beff3-0092-4844-958f-ed6f6ef8b108" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.586237] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b55beff3-0092-4844-958f-ed6f6ef8b108',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.587493] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b41fce3c-ebbc-4777-a2c7-a89ccb8bd2b6 with status ACTIVE [ 1017.587767] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.588318] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.588318] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.588318] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.588318] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.588494] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.588552] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.588624] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.588854] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.588978] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.593185] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.593500] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.593586] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.593897] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.594477] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.594477] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b41fce3c-ebbc-4777-a2c7-a89ccb8bd2b6 is going to be updated. [ 1017.623223] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.623516] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.623516] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.623835] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.623835] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.624059] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b41fce3c-ebbc-4777-a2c7-a89ccb8bd2b6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.639798] env[70614]: INFO networking_nsxv3.common.synchronization [None req-dbdd5547-31f9-41e1-b3ac-3022c2fd65c7 None None] Enqueued Resource ID: 25e0c8d9-f198-4d30-95c0-7a223da06ac6 with Priority: HIGHEST for action port [ 1017.640455] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25e0c8d9-f198-4d30-95c0-7a223da06ac6 with Priority: HIGHEST for action port [ 1017.640755] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-25e0c8d9-f198-4d30-95c0-7a223da06ac6 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.640826] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-25e0c8d9-f198-4d30-95c0-7a223da06ac6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.640873] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-25e0c8d9-f198-4d30-95c0-7a223da06ac6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.641838] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-25e0c8d9-f198-4d30-95c0-7a223da06ac6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.642811] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25e0c8d9-f198-4d30-95c0-7a223da06ac6',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.008618] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.008974] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.008974] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.010015] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.010015] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.010015] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45904912-7759-4b89-83ba-2a95c86ca5fd already deleted. [ 1018.010015] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45904912-7759-4b89-83ba-2a95c86ca5fd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.010015] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45904912-7759-4b89-83ba-2a95c86ca5fd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.010015] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45904912-7759-4b89-83ba-2a95c86ca5fd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.010015] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45904912-7759-4b89-83ba-2a95c86ca5fd',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.017958] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.018236] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.018385] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.018684] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.019085] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.019085] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port bb06fe20-5d3c-4255-9b67-d1281dcd60df not found, creating... [ 1018.019360] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.019538] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.020028] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.020028] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.020028] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.020351] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.020535] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.020663] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.021387] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.023545] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.023823] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: bb06fe20-5d3c-4255-9b67-d1281dcd60df is going to be created. [ 1018.048395] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.048619] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.049372] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.049372] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.049372] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.049557] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-bb06fe20-5d3c-4255-9b67-d1281dcd60df" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.097245] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b55beff3-0092-4844-958f-ed6f6ef8b108',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.147298] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 25e0c8d9-f198-4d30-95c0-7a223da06ac6 [ 1018.147298] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.147298] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.147298] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.147298] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.147298] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.147298] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:25e0c8d9-f198-4d30-95c0-7a223da06ac6 already deleted. [ 1018.147298] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-25e0c8d9-f198-4d30-95c0-7a223da06ac6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.536708] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.536708] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.536708] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.536708] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.536708] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.536708] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45904912-7759-4b89-83ba-2a95c86ca5fd already deleted. [ 1018.536708] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45904912-7759-4b89-83ba-2a95c86ca5fd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.600320] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.600437] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.600547] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.601214] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.601214] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.601214] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b55beff3-0092-4844-958f-ed6f6ef8b108 is going to be created. [ 1018.628927] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.629116] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.629164] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.629459] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.629621] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.640683] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b55beff3-0092-4844-958f-ed6f6ef8b108 in Status: UNINITIALIZED for 2s [ 1018.967836] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd5a38a7-babd-4c6b-b3a5-af13dd79865d in Status: SUCCESS [ 1018.968084] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dd5a38a7-babd-4c6b-b3a5-af13dd79865d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.214116] env[70614]: INFO networking_nsxv3.common.synchronization [req-0adf0cf3-0874-4b79-8148-5a8b4515b32a req-47dea34b-910d-4df3-a4a3-de29a40b0cda service nova] Enqueued Resource ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f with Priority: HIGHEST for action security_group_rules [ 1019.214439] env[70614]: INFO networking_nsxv3.common.synchronization [req-0adf0cf3-0874-4b79-8148-5a8b4515b32a req-47dea34b-910d-4df3-a4a3-de29a40b0cda service nova] Enqueued Resource ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f with Priority: HIGHEST for action security_group_members [ 1019.214439] env[70614]: INFO networking_nsxv3.common.synchronization [req-0adf0cf3-0874-4b79-8148-5a8b4515b32a req-47dea34b-910d-4df3-a4a3-de29a40b0cda service nova] Enqueued Resource ID: bb06fe20-5d3c-4255-9b67-d1281dcd60df with Priority: HIGHEST for action port [ 1019.218228] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f with Priority: HIGHEST for action security_group_rules [ 1019.218228] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f with Priority: HIGHEST for action security_group_members [ 1019.218228] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb06fe20-5d3c-4255-9b67-d1281dcd60df with Priority: HIGHEST for action port [ 1019.221356] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df8f20f5-6e92-4ac4-bdd2-05863ac4905f taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.221501] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.221577] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.221861] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.221954] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df8f20f5-6e92-4ac4-bdd2-05863ac4905f',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.222951] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.223750] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.223922] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-bb06fe20-5d3c-4255-9b67-d1281dcd60df taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.224111] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bb06fe20-5d3c-4255-9b67-d1281dcd60df" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.224190] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bb06fe20-5d3c-4255-9b67-d1281dcd60df" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.224430] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bb06fe20-5d3c-4255-9b67-d1281dcd60df" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.224549] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb06fe20-5d3c-4255-9b67-d1281dcd60df',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.228765] env[70614]: INFO networking_nsxv3.common.synchronization [req-40762ef2-9713-458c-8f3b-13b78bf4c806 req-3f552a22-456b-4b44-b797-9a2f358d6d08 tempest-VolumesAdminNegativeTest-2045600642 tempest-VolumesAdminNegativeTest-2045600642-project-member] Enqueued Resource ID: 77b7addf-0db2-4091-a32b-1272c6ac49b5 with Priority: HIGHEST for action security_group_members [ 1019.229746] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77b7addf-0db2-4091-a32b-1272c6ac49b5 with Priority: HIGHEST for action security_group_members [ 1019.229815] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-77b7addf-0db2-4091-a32b-1272c6ac49b5 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.229955] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77b7addf-0db2-4091-a32b-1272c6ac49b5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.230043] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77b7addf-0db2-4091-a32b-1272c6ac49b5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.230306] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77b7addf-0db2-4091-a32b-1272c6ac49b5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.230475] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.230587] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.230643] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.232032] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.232032] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.232032] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77b7addf-0db2-4091-a32b-1272c6ac49b5',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.351164] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f in Status: SUCCESS [ 1019.351339] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f deletion is rescheduled due to dependency. [ 1019.351459] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.352156] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.352377] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.352566] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.352685] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.352756] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.352897] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.352972] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.353082] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df8f20f5-6e92-4ac4-bdd2-05863ac4905f',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.726601] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.726717] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.729117] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bb06fe20-5d3c-4255-9b67-d1281dcd60df with status ACTIVE [ 1019.729639] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.729758] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.729758] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.730505] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.730505] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.732266] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.732469] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.732528] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.732834] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.732996] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.733323] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.733963] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.733963] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.733963] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.733963] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.734224] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bb06fe20-5d3c-4255-9b67-d1281dcd60df is going to be updated. [ 1019.736890] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.737104] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.737207] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.737456] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.737583] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.737924] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.738065] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.738112] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.738274] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.738389] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.738523] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77b7addf-0db2-4091-a32b-1272c6ac49b5 already deleted. [ 1019.738801] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77b7addf-0db2-4091-a32b-1272c6ac49b5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.765319] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.765834] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.765834] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.766100] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.766252] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.766424] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bb06fe20-5d3c-4255-9b67-d1281dcd60df" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.859984] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('df8f20f5-6e92-4ac4-bdd2-05863ac4905f',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.969215] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-392 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.969467] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-392" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.969602] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-392" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.969884] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-392" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.972503] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.972762] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.972907] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.973259] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.973440] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.973701] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1019.973924] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1019.974027] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1019.974102] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1019.974308] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1019.974396] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1019.974661] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1019.998384] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1019.998384] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1019.998384] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1019.998384] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-392" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.001365] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-597a8ffb-7018-4079-b487-86b4fdb3af8d taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.003840] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-597a8ffb-7018-4079-b487-86b4fdb3af8d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.003840] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-597a8ffb-7018-4079-b487-86b4fdb3af8d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.003840] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-597a8ffb-7018-4079-b487-86b4fdb3af8d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.003840] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('597a8ffb-7018-4079-b487-86b4fdb3af8d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.362219] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('df8f20f5-6e92-4ac4-bdd2-05863ac4905f',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.506392] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.506392] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.506392] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.506392] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.506392] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.506633] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 597a8ffb-7018-4079-b487-86b4fdb3af8d not found, creating... [ 1020.506668] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.507713] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.507713] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.507713] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.507713] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.507713] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.508053] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.508053] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.508130] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.508265] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.508422] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 597a8ffb-7018-4079-b487-86b4fdb3af8d is going to be created. [ 1020.532862] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.533058] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.533108] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.533371] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.533646] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.533952] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-597a8ffb-7018-4079-b487-86b4fdb3af8d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.655624] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b55beff3-0092-4844-958f-ed6f6ef8b108 in Status: SUCCESS [ 1020.655624] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b55beff3-0092-4844-958f-ed6f6ef8b108" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.655624] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b55beff3-0092-4844-958f-ed6f6ef8b108" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.655624] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b55beff3-0092-4844-958f-ed6f6ef8b108" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.655624] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.655624] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.655624] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.655624] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.655624] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.655624] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b55beff3-0092-4844-958f-ed6f6ef8b108" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.655624] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b55beff3-0092-4844-958f-ed6f6ef8b108',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.864472] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.864635] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.864710] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.864950] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.865024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.865124] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f is going to be updated. [ 1020.899585] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.899727] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.899802] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.900014] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.900198] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.910975] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f in Status: IN_PROGRESS for 2s [ 1021.162212] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-b55beff3-0092-4844-958f-ed6f6ef8b108 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.162212] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b55beff3-0092-4844-958f-ed6f6ef8b108" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.162212] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b55beff3-0092-4844-958f-ed6f6ef8b108" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.162212] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b55beff3-0092-4844-958f-ed6f6ef8b108" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.162212] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.162212] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.162212] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.162212] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.162212] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.162212] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b55beff3-0092-4844-958f-ed6f6ef8b108" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.162212] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-b55beff3-0092-4844-958f-ed6f6ef8b108 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.162212] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b55beff3-0092-4844-958f-ed6f6ef8b108" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.162212] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b55beff3-0092-4844-958f-ed6f6ef8b108" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.162212] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b55beff3-0092-4844-958f-ed6f6ef8b108" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.162212] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.162212] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.162895] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.162895] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.162895] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.162895] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b55beff3-0092-4844-958f-ed6f6ef8b108" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.162895] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b55beff3-0092-4844-958f-ed6f6ef8b108',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.605289] env[70614]: INFO networking_nsxv3.common.synchronization [req-40762ef2-9713-458c-8f3b-13b78bf4c806 req-c6853b2b-8279-472a-831b-12a49d2cfcef service nova] Enqueued Resource ID: 77b7addf-0db2-4091-a32b-1272c6ac49b5 with Priority: HIGHEST for action security_group_rules [ 1021.605289] env[70614]: INFO networking_nsxv3.common.synchronization [req-40762ef2-9713-458c-8f3b-13b78bf4c806 req-c6853b2b-8279-472a-831b-12a49d2cfcef service nova] Enqueued Resource ID: 77b7addf-0db2-4091-a32b-1272c6ac49b5 with Priority: HIGHEST for action security_group_members [ 1021.605660] env[70614]: INFO networking_nsxv3.common.synchronization [req-40762ef2-9713-458c-8f3b-13b78bf4c806 req-c6853b2b-8279-472a-831b-12a49d2cfcef service nova] Enqueued Resource ID: 597a8ffb-7018-4079-b487-86b4fdb3af8d with Priority: HIGHEST for action port [ 1021.606213] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77b7addf-0db2-4091-a32b-1272c6ac49b5 with Priority: HIGHEST for action security_group_rules [ 1021.606213] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77b7addf-0db2-4091-a32b-1272c6ac49b5 with Priority: HIGHEST for action security_group_members [ 1021.606344] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 597a8ffb-7018-4079-b487-86b4fdb3af8d with Priority: HIGHEST for action port [ 1021.607982] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-77b7addf-0db2-4091-a32b-1272c6ac49b5 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.607982] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-77b7addf-0db2-4091-a32b-1272c6ac49b5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.607982] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-77b7addf-0db2-4091-a32b-1272c6ac49b5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.607982] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-77b7addf-0db2-4091-a32b-1272c6ac49b5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.607982] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('77b7addf-0db2-4091-a32b-1272c6ac49b5',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.607982] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-77b7addf-0db2-4091-a32b-1272c6ac49b5 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.608384] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77b7addf-0db2-4091-a32b-1272c6ac49b5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.608384] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77b7addf-0db2-4091-a32b-1272c6ac49b5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.608384] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77b7addf-0db2-4091-a32b-1272c6ac49b5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.608535] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.608621] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.608679] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.608812] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.608892] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.608982] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77b7addf-0db2-4091-a32b-1272c6ac49b5',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.609881] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-597a8ffb-7018-4079-b487-86b4fdb3af8d taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.610010] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-597a8ffb-7018-4079-b487-86b4fdb3af8d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.613184] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-597a8ffb-7018-4079-b487-86b4fdb3af8d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.613184] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-597a8ffb-7018-4079-b487-86b4fdb3af8d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.613184] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('597a8ffb-7018-4079-b487-86b4fdb3af8d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.669469] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b55beff3-0092-4844-958f-ed6f6ef8b108: rpc.has_security_group_logging(os_id): False [ 1021.702793] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.703033] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.703033] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.703692] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.703692] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.703692] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.703692] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.703979] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.703979] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.703979] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.704339] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.704339] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.704339] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.704483] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.704483] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.704657] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.704813] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.704813] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.704990] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.705924] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.706089] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b55beff3-0092-4844-958f-ed6f6ef8b108 is going to be created. [ 1021.790478] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.791065] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.791172] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.791351] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.791528] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.807351] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b55beff3-0092-4844-958f-ed6f6ef8b108 in Status: IN_PROGRESS for 2s [ 1021.942652] env[70614]: INFO networking_nsxv3.common.synchronization [req-e90dcb77-41be-4517-983d-416a862c7023 req-b5f7775f-775d-48fb-a82c-15112cd5b767 tempest-ServerPasswordTestJSON-360226754 tempest-ServerPasswordTestJSON-360226754-project-member] Enqueued Resource ID: 7ea2558c-aa82-4694-8be9-307b8ca3e536 with Priority: HIGHEST for action security_group_members [ 1021.943336] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ea2558c-aa82-4694-8be9-307b8ca3e536 with Priority: HIGHEST for action security_group_members [ 1021.943752] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ea2558c-aa82-4694-8be9-307b8ca3e536 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.943905] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ea2558c-aa82-4694-8be9-307b8ca3e536" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.944014] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ea2558c-aa82-4694-8be9-307b8ca3e536" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.949020] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ea2558c-aa82-4694-8be9-307b8ca3e536" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.949020] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.949020] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.949020] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.949020] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.949020] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.949020] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ea2558c-aa82-4694-8be9-307b8ca3e536',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.117241] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-77b7addf-0db2-4091-a32b-1272c6ac49b5 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.117871] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77b7addf-0db2-4091-a32b-1272c6ac49b5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.118250] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('77b7addf-0db2-4091-a32b-1272c6ac49b5',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.122245] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 597a8ffb-7018-4079-b487-86b4fdb3af8d with status ACTIVE [ 1022.122933] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.122933] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.122933] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.122933] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.122933] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.123193] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.123193] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.123265] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.123367] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.123445] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.126887] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.126887] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.126887] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.126887] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.126887] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.126887] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 597a8ffb-7018-4079-b487-86b4fdb3af8d is going to be updated. [ 1022.154634] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.154868] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.154935] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.155261] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.155430] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.155623] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-597a8ffb-7018-4079-b487-86b4fdb3af8d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.451117] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.451311] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.451386] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.451763] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.451892] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.452154] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.452287] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.452353] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.452678] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.453172] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.453172] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ea2558c-aa82-4694-8be9-307b8ca3e536 already deleted. [ 1022.453172] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ea2558c-aa82-4694-8be9-307b8ca3e536" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.629242] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('77b7addf-0db2-4091-a32b-1272c6ac49b5',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.684128] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-301 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.684296] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-301" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.684477] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-301" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.684890] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-301" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.686470] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.686679] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.686807] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.687073] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.687242] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.687712] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1022.687712] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1022.687831] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1022.688012] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1022.688183] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1022.688315] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1022.688481] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1022.713690] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1022.713852] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1022.713995] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1022.714202] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-301" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.714538] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-904e75fc-5d3a-451f-ba9e-294b187f819b taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.714721] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-904e75fc-5d3a-451f-ba9e-294b187f819b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.714861] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-904e75fc-5d3a-451f-ba9e-294b187f819b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.716219] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-904e75fc-5d3a-451f-ba9e-294b187f819b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.716219] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('904e75fc-5d3a-451f-ba9e-294b187f819b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.922294] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f in Status: SUCCESS [ 1022.923697] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.923845] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.924096] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.924429] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.924429] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.924609] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.924661] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.924735] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.924859] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.924959] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('df8f20f5-6e92-4ac4-bdd2-05863ac4905f',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.131627] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.131868] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.131974] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.132223] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.132316] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.132420] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77b7addf-0db2-4091-a32b-1272c6ac49b5 is going to be created. [ 1023.171716] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.171891] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.171938] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.172164] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.172329] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.183072] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77b7addf-0db2-4091-a32b-1272c6ac49b5 in Status: UNINITIALIZED for 2s [ 1023.219021] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.219278] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.219581] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.219934] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.220113] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.220289] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 904e75fc-5d3a-451f-ba9e-294b187f819b not found, creating... [ 1023.220671] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.220855] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.220980] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.221269] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.221422] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.221767] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.221942] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.222441] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.222441] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.222656] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.222656] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 904e75fc-5d3a-451f-ba9e-294b187f819b is going to be created. [ 1023.257126] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.257989] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.257989] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.257989] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.258255] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.258531] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-904e75fc-5d3a-451f-ba9e-294b187f819b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.428183] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.428427] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.428507] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.429279] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.429279] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.429473] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.429473] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.430621] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.430621] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.430621] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.430621] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.430621] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.430621] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.430621] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.430942] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.430942] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.430942] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.431059] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.431140] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.431212] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.431306] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('df8f20f5-6e92-4ac4-bdd2-05863ac4905f',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.819796] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b55beff3-0092-4844-958f-ed6f6ef8b108 in Status: SUCCESS [ 1023.820695] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b55beff3-0092-4844-958f-ed6f6ef8b108" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.935119] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for df8f20f5-6e92-4ac4-bdd2-05863ac4905f: rpc.has_security_group_logging(os_id): False [ 1023.960408] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.963022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.963022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.963022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.963022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.963022] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.963022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.963022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.963022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.963022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.963022] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.963022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.963022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.963022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.963022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.964233] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.964233] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.964233] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.964233] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.964233] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.964233] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f is going to be updated. [ 1024.043379] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.043585] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.043659] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.043875] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.044045] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.063044] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f in Status: IN_PROGRESS for 2s [ 1024.225861] env[70614]: INFO networking_nsxv3.common.synchronization [req-e90dcb77-41be-4517-983d-416a862c7023 req-9411d9ed-1570-4b8d-9eba-214304d80c78 service nova] Enqueued Resource ID: 7ea2558c-aa82-4694-8be9-307b8ca3e536 with Priority: HIGHEST for action security_group_rules [ 1024.226185] env[70614]: INFO networking_nsxv3.common.synchronization [req-e90dcb77-41be-4517-983d-416a862c7023 req-9411d9ed-1570-4b8d-9eba-214304d80c78 service nova] Enqueued Resource ID: 7ea2558c-aa82-4694-8be9-307b8ca3e536 with Priority: HIGHEST for action security_group_members [ 1024.226286] env[70614]: INFO networking_nsxv3.common.synchronization [req-e90dcb77-41be-4517-983d-416a862c7023 req-9411d9ed-1570-4b8d-9eba-214304d80c78 service nova] Enqueued Resource ID: 904e75fc-5d3a-451f-ba9e-294b187f819b with Priority: HIGHEST for action port [ 1024.235338] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ea2558c-aa82-4694-8be9-307b8ca3e536 with Priority: HIGHEST for action security_group_rules [ 1024.235338] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ea2558c-aa82-4694-8be9-307b8ca3e536 with Priority: HIGHEST for action security_group_members [ 1024.235338] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 904e75fc-5d3a-451f-ba9e-294b187f819b with Priority: HIGHEST for action port [ 1024.235338] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ea2558c-aa82-4694-8be9-307b8ca3e536 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.235338] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ea2558c-aa82-4694-8be9-307b8ca3e536" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.235338] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ea2558c-aa82-4694-8be9-307b8ca3e536" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.235695] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ea2558c-aa82-4694-8be9-307b8ca3e536" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.235695] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ea2558c-aa82-4694-8be9-307b8ca3e536',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.237081] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ea2558c-aa82-4694-8be9-307b8ca3e536 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.237081] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ea2558c-aa82-4694-8be9-307b8ca3e536" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.237081] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ea2558c-aa82-4694-8be9-307b8ca3e536" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.237274] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ea2558c-aa82-4694-8be9-307b8ca3e536" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.237336] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.237422] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.237482] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.237632] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.237726] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.237821] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ea2558c-aa82-4694-8be9-307b8ca3e536',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.239255] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-904e75fc-5d3a-451f-ba9e-294b187f819b taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.239408] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-904e75fc-5d3a-451f-ba9e-294b187f819b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.239477] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-904e75fc-5d3a-451f-ba9e-294b187f819b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.240104] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-904e75fc-5d3a-451f-ba9e-294b187f819b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.240104] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('904e75fc-5d3a-451f-ba9e-294b187f819b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.743025] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ea2558c-aa82-4694-8be9-307b8ca3e536 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.743170] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ea2558c-aa82-4694-8be9-307b8ca3e536" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.743867] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7ea2558c-aa82-4694-8be9-307b8ca3e536',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.744130] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 904e75fc-5d3a-451f-ba9e-294b187f819b with status ACTIVE [ 1024.744359] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.744514] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.744588] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.744813] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.744876] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.745390] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.745390] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.745390] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.745390] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.745619] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.745619] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.745691] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.745774] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.745877] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.746108] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.746266] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 904e75fc-5d3a-451f-ba9e-294b187f819b is going to be updated. [ 1024.771555] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.772019] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.772019] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.772272] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.772451] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.772705] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-904e75fc-5d3a-451f-ba9e-294b187f819b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.201017] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77b7addf-0db2-4091-a32b-1272c6ac49b5 in Status: SUCCESS [ 1025.201341] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77b7addf-0db2-4091-a32b-1272c6ac49b5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.201585] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77b7addf-0db2-4091-a32b-1272c6ac49b5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.201895] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77b7addf-0db2-4091-a32b-1272c6ac49b5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.202177] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.202397] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.202512] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.203169] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.203169] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.203169] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77b7addf-0db2-4091-a32b-1272c6ac49b5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.203169] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('77b7addf-0db2-4091-a32b-1272c6ac49b5',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.250049] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7ea2558c-aa82-4694-8be9-307b8ca3e536',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.706609] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-77b7addf-0db2-4091-a32b-1272c6ac49b5 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.708814] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77b7addf-0db2-4091-a32b-1272c6ac49b5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.708814] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77b7addf-0db2-4091-a32b-1272c6ac49b5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.708814] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77b7addf-0db2-4091-a32b-1272c6ac49b5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.708814] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.708814] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.708814] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.708814] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.708814] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.708814] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77b7addf-0db2-4091-a32b-1272c6ac49b5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.708814] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-77b7addf-0db2-4091-a32b-1272c6ac49b5 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.709353] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77b7addf-0db2-4091-a32b-1272c6ac49b5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.710321] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77b7addf-0db2-4091-a32b-1272c6ac49b5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.710321] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77b7addf-0db2-4091-a32b-1272c6ac49b5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.710321] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.710321] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.710321] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.710321] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.710675] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.710675] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77b7addf-0db2-4091-a32b-1272c6ac49b5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.710845] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('77b7addf-0db2-4091-a32b-1272c6ac49b5',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.752790] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.752995] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.753051] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.753256] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.753349] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.753472] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ea2558c-aa82-4694-8be9-307b8ca3e536 is going to be created. [ 1025.781059] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.781351] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.781351] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.781566] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.781707] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.793466] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ea2558c-aa82-4694-8be9-307b8ca3e536 in Status: UNINITIALIZED for 2s [ 1026.083435] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f in Status: SUCCESS [ 1026.083435] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.215851] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 77b7addf-0db2-4091-a32b-1272c6ac49b5: rpc.has_security_group_logging(os_id): False [ 1026.247189] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.247189] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.247189] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.247566] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.247566] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.247808] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.247927] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.247993] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.248279] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.248373] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.248598] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.248716] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.248807] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.248978] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.249081] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.249393] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.249530] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.249598] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.249777] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.249863] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.249956] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 77b7addf-0db2-4091-a32b-1272c6ac49b5 is going to be created. [ 1026.333564] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.333812] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.333874] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.335059] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.335059] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.351066] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 77b7addf-0db2-4091-a32b-1272c6ac49b5 in Status: IN_PROGRESS for 2s [ 1027.807867] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ea2558c-aa82-4694-8be9-307b8ca3e536 in Status: SUCCESS [ 1027.808244] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ea2558c-aa82-4694-8be9-307b8ca3e536" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.808303] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ea2558c-aa82-4694-8be9-307b8ca3e536" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.808508] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ea2558c-aa82-4694-8be9-307b8ca3e536" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.808706] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.808849] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.808946] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.809050] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.809119] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.809226] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ea2558c-aa82-4694-8be9-307b8ca3e536" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.809369] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7ea2558c-aa82-4694-8be9-307b8ca3e536',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.317047] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ea2558c-aa82-4694-8be9-307b8ca3e536 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.317047] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ea2558c-aa82-4694-8be9-307b8ca3e536" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.317047] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ea2558c-aa82-4694-8be9-307b8ca3e536" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.317047] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ea2558c-aa82-4694-8be9-307b8ca3e536" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.317047] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.317047] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.317047] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.317047] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.317047] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.317047] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ea2558c-aa82-4694-8be9-307b8ca3e536" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.317047] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ea2558c-aa82-4694-8be9-307b8ca3e536 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.317047] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ea2558c-aa82-4694-8be9-307b8ca3e536" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.317047] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ea2558c-aa82-4694-8be9-307b8ca3e536" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.317047] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ea2558c-aa82-4694-8be9-307b8ca3e536" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.317047] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.317047] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.317958] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.317958] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.317958] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.317958] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ea2558c-aa82-4694-8be9-307b8ca3e536" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.317958] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7ea2558c-aa82-4694-8be9-307b8ca3e536',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.367077] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 77b7addf-0db2-4091-a32b-1272c6ac49b5 in Status: SUCCESS [ 1028.367475] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-77b7addf-0db2-4091-a32b-1272c6ac49b5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.390769] env[70614]: INFO networking_nsxv3.common.synchronization [req-68e0ee21-6527-4c6f-90f0-faf489c271cb req-3533c813-ad2a-421f-ab32-99407592cfac tempest-ServersNegativeTestMultiTenantJSON-874674398 tempest-ServersNegativeTestMultiTenantJSON-874674398-project-member] Enqueued Resource ID: b55beff3-0092-4844-958f-ed6f6ef8b108 with Priority: HIGHEST for action security_group_members [ 1028.391758] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b55beff3-0092-4844-958f-ed6f6ef8b108 with Priority: HIGHEST for action security_group_members [ 1028.392290] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-b55beff3-0092-4844-958f-ed6f6ef8b108 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.392563] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b55beff3-0092-4844-958f-ed6f6ef8b108" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.392765] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b55beff3-0092-4844-958f-ed6f6ef8b108" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.393075] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b55beff3-0092-4844-958f-ed6f6ef8b108" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.393337] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.393570] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.393716] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.393957] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.394174] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.394369] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b55beff3-0092-4844-958f-ed6f6ef8b108',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.822471] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7ea2558c-aa82-4694-8be9-307b8ca3e536: rpc.has_security_group_logging(os_id): False [ 1028.841307] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.841307] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.841307] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.841307] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.842413] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.842413] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.842413] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.842413] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.842413] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.842413] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.842413] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.842413] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.842413] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.842767] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.842767] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.842840] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.842888] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.843125] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.843125] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.843212] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.843307] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ea2558c-aa82-4694-8be9-307b8ca3e536 is going to be created. [ 1028.897268] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.897605] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.897696] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.897930] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.898044] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.898266] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.898399] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.898464] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.898632] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.898718] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.898809] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b55beff3-0092-4844-958f-ed6f6ef8b108 is going to be updated. [ 1028.924942] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.925203] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.925289] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.925545] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.925804] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.946781] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.947037] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.947175] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.947466] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.947672] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.949431] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ea2558c-aa82-4694-8be9-307b8ca3e536 in Status: IN_PROGRESS for 2s [ 1028.959122] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b55beff3-0092-4844-958f-ed6f6ef8b108 in Status: IN_PROGRESS for 2s [ 1029.612272] env[70614]: INFO networking_nsxv3.common.synchronization [req-55b41b09-91bb-4737-903a-64764643b2eb req-6d56d809-465f-4a44-934a-9bd28a209679 tempest-AttachInterfacesTestJSON-1919943007 tempest-AttachInterfacesTestJSON-1919943007-project-member] Enqueued Resource ID: ca55d9c7-11be-476b-bdb5-63e4c956a4de with Priority: HIGHEST for action security_group_members [ 1029.615394] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca55d9c7-11be-476b-bdb5-63e4c956a4de with Priority: HIGHEST for action security_group_members [ 1029.615394] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca55d9c7-11be-476b-bdb5-63e4c956a4de taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.615394] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca55d9c7-11be-476b-bdb5-63e4c956a4de" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.615394] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca55d9c7-11be-476b-bdb5-63e4c956a4de" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.615394] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca55d9c7-11be-476b-bdb5-63e4c956a4de" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.615394] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.615394] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.615394] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.615394] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.615394] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.615394] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca55d9c7-11be-476b-bdb5-63e4c956a4de',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.117194] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca55d9c7-11be-476b-bdb5-63e4c956a4de',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.232511] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-385 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.232511] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-385" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.232511] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-385" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.232511] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-385" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.232977] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.233442] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.233656] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.233957] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.234179] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.234449] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1030.234632] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1030.234811] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1030.234997] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1030.235191] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1030.236058] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1030.236058] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1030.260563] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1030.260746] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1030.260883] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1030.261082] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-385" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.261489] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-c726a891-fe08-477a-856e-65d56a39bcab taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.261808] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-c726a891-fe08-477a-856e-65d56a39bcab" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.261888] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-c726a891-fe08-477a-856e-65d56a39bcab" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.265454] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-c726a891-fe08-477a-856e-65d56a39bcab" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.265627] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c726a891-fe08-477a-856e-65d56a39bcab',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.383619] env[70614]: INFO networking_nsxv3.common.synchronization [req-6fb836b4-ca3e-4185-9b3b-a729c086e9a4 req-4d892a96-8925-430c-a18b-4ede72d975fa tempest-ImagesTestJSON-1765947257 tempest-ImagesTestJSON-1765947257-project-member] Enqueued Resource ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 with Priority: HIGHEST for action security_group_members [ 1030.384512] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 with Priority: HIGHEST for action security_group_members [ 1030.388022] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-04a082fe-52f7-4ac6-a12b-63791c63be86 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.388022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.388022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.388022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.388022] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.388022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.388022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.388022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.388022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.388022] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04a082fe-52f7-4ac6-a12b-63791c63be86',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.620159] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca55d9c7-11be-476b-bdb5-63e4c956a4de',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.773089] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.773089] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.773089] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.773429] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.773429] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.773579] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port c726a891-fe08-477a-856e-65d56a39bcab not found, creating... [ 1030.773960] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.774192] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.774401] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.774688] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.774922] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.775279] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.775482] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.775609] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.776157] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.776157] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.776157] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: c726a891-fe08-477a-856e-65d56a39bcab is going to be created. [ 1030.807216] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.807510] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.807651] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.807938] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.808185] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.808422] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-c726a891-fe08-477a-856e-65d56a39bcab" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.888750] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.888996] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.888996] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.889228] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.889321] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.889600] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.889727] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.889780] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.889910] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.889910] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.890133] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 is going to be updated. [ 1030.945322] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.945521] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.945566] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.945751] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.945963] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.964432] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 in Status: IN_PROGRESS for 2s [ 1030.971041] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ea2558c-aa82-4694-8be9-307b8ca3e536 in Status: SUCCESS [ 1030.971188] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ea2558c-aa82-4694-8be9-307b8ca3e536" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.990123] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b55beff3-0092-4844-958f-ed6f6ef8b108 in Status: SUCCESS [ 1030.990123] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b55beff3-0092-4844-958f-ed6f6ef8b108 deletion is rescheduled due to dependency. [ 1030.990123] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b55beff3-0092-4844-958f-ed6f6ef8b108" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.126146] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.126146] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.126146] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.126146] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.126146] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.126146] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca55d9c7-11be-476b-bdb5-63e4c956a4de is going to be updated. [ 1031.161319] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.161319] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.161319] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.161319] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.161319] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.176182] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca55d9c7-11be-476b-bdb5-63e4c956a4de in Status: IN_PROGRESS for 2s [ 1031.662303] env[70614]: INFO networking_nsxv3.common.synchronization [req-55b41b09-91bb-4737-903a-64764643b2eb req-f685b6b6-6754-4a12-9da5-871344bc3196 service nova] Enqueued Resource ID: ca55d9c7-11be-476b-bdb5-63e4c956a4de with Priority: HIGHEST for action security_group_rules [ 1031.662478] env[70614]: INFO networking_nsxv3.common.synchronization [req-55b41b09-91bb-4737-903a-64764643b2eb req-f685b6b6-6754-4a12-9da5-871344bc3196 service nova] Enqueued Resource ID: ca55d9c7-11be-476b-bdb5-63e4c956a4de with Priority: HIGHEST for action security_group_members [ 1031.662593] env[70614]: INFO networking_nsxv3.common.synchronization [req-55b41b09-91bb-4737-903a-64764643b2eb req-f685b6b6-6754-4a12-9da5-871344bc3196 service nova] Enqueued Resource ID: c726a891-fe08-477a-856e-65d56a39bcab with Priority: HIGHEST for action port [ 1031.664787] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca55d9c7-11be-476b-bdb5-63e4c956a4de with Priority: HIGHEST for action security_group_rules [ 1031.665146] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca55d9c7-11be-476b-bdb5-63e4c956a4de with Priority: HIGHEST for action security_group_members [ 1031.665336] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c726a891-fe08-477a-856e-65d56a39bcab with Priority: HIGHEST for action port [ 1031.665920] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca55d9c7-11be-476b-bdb5-63e4c956a4de taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.666132] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca55d9c7-11be-476b-bdb5-63e4c956a4de" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.666285] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca55d9c7-11be-476b-bdb5-63e4c956a4de" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.666624] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca55d9c7-11be-476b-bdb5-63e4c956a4de" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.666773] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca55d9c7-11be-476b-bdb5-63e4c956a4de',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.673356] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca55d9c7-11be-476b-bdb5-63e4c956a4de taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.673356] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca55d9c7-11be-476b-bdb5-63e4c956a4de" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.673356] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-c726a891-fe08-477a-856e-65d56a39bcab taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.673356] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c726a891-fe08-477a-856e-65d56a39bcab" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.673356] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c726a891-fe08-477a-856e-65d56a39bcab" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.673356] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c726a891-fe08-477a-856e-65d56a39bcab" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.673356] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c726a891-fe08-477a-856e-65d56a39bcab',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.175497] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca55d9c7-11be-476b-bdb5-63e4c956a4de taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.175859] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca55d9c7-11be-476b-bdb5-63e4c956a4de" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.175907] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c726a891-fe08-477a-856e-65d56a39bcab with status ACTIVE [ 1032.176124] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.176259] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.176334] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.176587] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.176700] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.176893] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.177051] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.177120] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.177489] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.177581] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.177754] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.177851] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.177934] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.180738] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.180853] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.180964] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c726a891-fe08-477a-856e-65d56a39bcab is going to be updated. [ 1032.227373] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.227563] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.227651] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.228100] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.228100] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.228266] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c726a891-fe08-477a-856e-65d56a39bcab" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.976594] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 in Status: SUCCESS [ 1032.976594] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 deletion is rescheduled due to dependency. [ 1032.976594] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.188700] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca55d9c7-11be-476b-bdb5-63e4c956a4de in Status: SUCCESS [ 1033.191039] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca55d9c7-11be-476b-bdb5-63e4c956a4de" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.191039] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca55d9c7-11be-476b-bdb5-63e4c956a4de" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.191039] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca55d9c7-11be-476b-bdb5-63e4c956a4de" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.191497] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.191497] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.191497] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.191497] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.191862] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.191862] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca55d9c7-11be-476b-bdb5-63e4c956a4de',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.694682] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca55d9c7-11be-476b-bdb5-63e4c956a4de',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.198674] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca55d9c7-11be-476b-bdb5-63e4c956a4de',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.379891] env[70614]: INFO networking_nsxv3.common.synchronization [req-aa6555b7-98eb-4826-80c8-df3310d0b3d0 req-8a75fef3-8618-4dfd-bd71-554d5d613a47 tempest-ServerActionsTestOtherB-1079543702 tempest-ServerActionsTestOtherB-1079543702-project-member] Enqueued Resource ID: 4e54f39e-349d-49ad-bb07-348488d846f0 with Priority: HIGHEST for action security_group_members [ 1034.380600] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e54f39e-349d-49ad-bb07-348488d846f0 with Priority: HIGHEST for action security_group_members [ 1034.380976] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e54f39e-349d-49ad-bb07-348488d846f0 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.381193] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.381292] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.381541] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.381878] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.381878] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.382074] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.382134] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.382264] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.382323] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e54f39e-349d-49ad-bb07-348488d846f0',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.456715] env[70614]: INFO networking_nsxv3.common.synchronization [req-1523500a-eb2a-41c7-bf85-d9a717e61a25 req-21036b67-4f9c-46f8-817b-5b142274277d tempest-DeleteServersTestJSON-1690139659 tempest-DeleteServersTestJSON-1690139659-project-member] Enqueued Resource ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f with Priority: HIGHEST for action security_group_members [ 1034.457433] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f with Priority: HIGHEST for action security_group_members [ 1034.458785] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.458785] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.458785] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.459885] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.459967] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.460359] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.460359] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.460359] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.460762] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.460762] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df8f20f5-6e92-4ac4-bdd2-05863ac4905f',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.703340] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.703578] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.703578] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.703778] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.703919] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.704070] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca55d9c7-11be-476b-bdb5-63e4c956a4de is going to be updated. [ 1034.742746] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.742746] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.742746] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.742746] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.742746] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.754343] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca55d9c7-11be-476b-bdb5-63e4c956a4de in Status: IN_PROGRESS for 2s [ 1034.886386] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.886644] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.886766] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.887080] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.887177] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.887467] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.887623] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.887708] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.887946] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.888088] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.888200] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e54f39e-349d-49ad-bb07-348488d846f0 is going to be updated. [ 1034.923925] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.924101] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.924174] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.924591] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.924752] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.940031] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e54f39e-349d-49ad-bb07-348488d846f0 in Status: IN_PROGRESS for 2s [ 1034.963941] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.964124] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.964214] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.964449] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.964532] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.964799] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.964955] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.964955] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.965122] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.965189] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.965277] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f is going to be updated. [ 1034.998737] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.999981] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.999981] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.999981] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.999981] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.012299] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f in Status: IN_PROGRESS for 2s [ 1035.037038] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-883 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.037275] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-883" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.037404] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-883" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.037690] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-883" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.037962] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.038140] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.038263] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.038488] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.038641] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.038853] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1035.038968] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1035.039092] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1035.039203] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1035.039314] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1035.039461] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1035.039613] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1035.063009] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1035.063242] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1035.063337] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1035.063522] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-883" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.063992] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-d835d7a6-52c3-43c4-9763-2b40be6da034 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.064301] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-d835d7a6-52c3-43c4-9763-2b40be6da034" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.064442] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-d835d7a6-52c3-43c4-9763-2b40be6da034" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.064785] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-d835d7a6-52c3-43c4-9763-2b40be6da034" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.064936] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d835d7a6-52c3-43c4-9763-2b40be6da034',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.568218] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.568587] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.568730] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.569102] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.569326] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.569554] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port d835d7a6-52c3-43c4-9763-2b40be6da034 not found, creating... [ 1035.569901] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.570137] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.570327] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.570661] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.570843] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.571255] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.571503] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.571644] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.571940] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.572124] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.572305] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: d835d7a6-52c3-43c4-9763-2b40be6da034 is going to be created. [ 1035.649101] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.649452] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.649605] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.649932] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.650193] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.650471] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-d835d7a6-52c3-43c4-9763-2b40be6da034" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.665810] env[70614]: INFO networking_nsxv3.common.synchronization [req-aa6555b7-98eb-4826-80c8-df3310d0b3d0 req-3bea2d11-886e-4769-9bb2-bc4b9b949af4 service nova] Enqueued Resource ID: 4e54f39e-349d-49ad-bb07-348488d846f0 with Priority: HIGHEST for action security_group_rules [ 1036.667862] env[70614]: INFO networking_nsxv3.common.synchronization [req-aa6555b7-98eb-4826-80c8-df3310d0b3d0 req-3bea2d11-886e-4769-9bb2-bc4b9b949af4 service nova] Enqueued Resource ID: 4e54f39e-349d-49ad-bb07-348488d846f0 with Priority: HIGHEST for action security_group_members [ 1036.667862] env[70614]: INFO networking_nsxv3.common.synchronization [req-aa6555b7-98eb-4826-80c8-df3310d0b3d0 req-3bea2d11-886e-4769-9bb2-bc4b9b949af4 service nova] Enqueued Resource ID: d835d7a6-52c3-43c4-9763-2b40be6da034 with Priority: HIGHEST for action port [ 1036.667862] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e54f39e-349d-49ad-bb07-348488d846f0 with Priority: HIGHEST for action security_group_rules [ 1036.667862] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e54f39e-349d-49ad-bb07-348488d846f0 with Priority: HIGHEST for action security_group_members [ 1036.667862] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d835d7a6-52c3-43c4-9763-2b40be6da034 with Priority: HIGHEST for action port [ 1036.671539] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e54f39e-349d-49ad-bb07-348488d846f0 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.671539] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.671539] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.671539] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.671539] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e54f39e-349d-49ad-bb07-348488d846f0',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.671539] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e54f39e-349d-49ad-bb07-348488d846f0 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.671539] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.671539] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-d835d7a6-52c3-43c4-9763-2b40be6da034 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.671539] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d835d7a6-52c3-43c4-9763-2b40be6da034" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.671539] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d835d7a6-52c3-43c4-9763-2b40be6da034" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.671539] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d835d7a6-52c3-43c4-9763-2b40be6da034" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.671539] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d835d7a6-52c3-43c4-9763-2b40be6da034',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.727384] env[70614]: INFO networking_nsxv3.common.synchronization [req-f643ee78-84d9-4a7d-92ad-019d9046813c req-aae4f858-f52b-4274-943e-e2901ea7ba5a tempest-VolumesAdminNegativeTest-2045600642 tempest-VolumesAdminNegativeTest-2045600642-project-member] Enqueued Resource ID: 77b7addf-0db2-4091-a32b-1272c6ac49b5 with Priority: HIGHEST for action security_group_members [ 1036.728237] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77b7addf-0db2-4091-a32b-1272c6ac49b5 with Priority: HIGHEST for action security_group_members [ 1036.729234] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-77b7addf-0db2-4091-a32b-1272c6ac49b5 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.729550] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77b7addf-0db2-4091-a32b-1272c6ac49b5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.729670] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77b7addf-0db2-4091-a32b-1272c6ac49b5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.730975] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77b7addf-0db2-4091-a32b-1272c6ac49b5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.731294] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.731485] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.732208] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.732208] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.732208] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.732506] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77b7addf-0db2-4091-a32b-1272c6ac49b5',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.770564] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca55d9c7-11be-476b-bdb5-63e4c956a4de in Status: SUCCESS [ 1036.770564] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca55d9c7-11be-476b-bdb5-63e4c956a4de" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.771298] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca55d9c7-11be-476b-bdb5-63e4c956a4de" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.771626] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca55d9c7-11be-476b-bdb5-63e4c956a4de" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.771989] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.772251] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.772392] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.772617] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.772859] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.773155] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca55d9c7-11be-476b-bdb5-63e4c956a4de" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.773314] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ca55d9c7-11be-476b-bdb5-63e4c956a4de',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.959309] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e54f39e-349d-49ad-bb07-348488d846f0 in Status: SUCCESS [ 1036.959309] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e54f39e-349d-49ad-bb07-348488d846f0 deletion is rescheduled due to dependency. [ 1036.959309] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.959309] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.959309] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.959309] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.959309] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.959309] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.959309] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.959309] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.959309] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e54f39e-349d-49ad-bb07-348488d846f0',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.023826] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f in Status: SUCCESS [ 1037.024062] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f deletion is rescheduled due to dependency. [ 1037.024236] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.174689] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e54f39e-349d-49ad-bb07-348488d846f0 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.174689] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.174689] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d835d7a6-52c3-43c4-9763-2b40be6da034 with status ACTIVE [ 1037.174689] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.174689] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.174689] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.175415] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.175415] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.175415] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.175415] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.175415] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.175415] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.177565] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.177565] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.177565] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.177565] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.177565] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.177565] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.177565] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d835d7a6-52c3-43c4-9763-2b40be6da034 is going to be updated. [ 1037.208095] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.208246] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.208314] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.208582] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.208759] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.208969] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d835d7a6-52c3-43c4-9763-2b40be6da034" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.235669] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.236652] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.236830] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.237082] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.237179] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.237678] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.237930] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.238023] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.238370] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.238474] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.238618] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77b7addf-0db2-4091-a32b-1272c6ac49b5 is going to be updated. [ 1037.275915] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ca55d9c7-11be-476b-bdb5-63e4c956a4de',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.281039] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.281294] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.281418] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.281655] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.281816] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.291215] env[70614]: INFO networking_nsxv3.common.synchronization [None req-3976ad29-04e8-4a23-81e3-6313b403c3ba None None] Enqueued Resource ID: 3cbb1b76-4f4c-42fa-813d-176ad06626d8 with Priority: HIGHEST for action port [ 1037.291733] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cbb1b76-4f4c-42fa-813d-176ad06626d8 with Priority: HIGHEST for action port [ 1037.292916] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-3cbb1b76-4f4c-42fa-813d-176ad06626d8 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.293142] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3cbb1b76-4f4c-42fa-813d-176ad06626d8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.293233] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3cbb1b76-4f4c-42fa-813d-176ad06626d8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.293506] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3cbb1b76-4f4c-42fa-813d-176ad06626d8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.293587] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3cbb1b76-4f4c-42fa-813d-176ad06626d8',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.302388] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77b7addf-0db2-4091-a32b-1272c6ac49b5 in Status: IN_PROGRESS for 2s [ 1037.457471] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4e54f39e-349d-49ad-bb07-348488d846f0',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.514167] env[70614]: INFO networking_nsxv3.common.synchronization [req-50f976d1-e324-446b-8359-6e14b52795f2 req-96372814-e98f-4529-b1a4-b12c3929f91c tempest-MultipleCreateTestJSON-983295494 tempest-MultipleCreateTestJSON-983295494-project-member] Enqueued Resource ID: d141340f-d099-4b67-88b0-348423856ab2 with Priority: HIGHEST for action security_group_members [ 1037.514811] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d141340f-d099-4b67-88b0-348423856ab2 with Priority: HIGHEST for action security_group_members [ 1037.515360] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-d141340f-d099-4b67-88b0-348423856ab2 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.515360] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.515360] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.515564] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.515720] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.515834] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.515898] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.516054] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.516139] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.516234] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d141340f-d099-4b67-88b0-348423856ab2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.778540] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ca55d9c7-11be-476b-bdb5-63e4c956a4de: rpc.has_security_group_logging(os_id): False [ 1037.802291] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.802481] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.807032] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.807032] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.807032] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.807032] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.807032] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.807032] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.807032] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.807032] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.807032] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca55d9c7-11be-476b-bdb5-63e4c956a4de is going to be updated. [ 1037.807781] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3cbb1b76-4f4c-42fa-813d-176ad06626d8 [ 1037.807781] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.807865] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.807916] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.808114] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.808409] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.808409] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3cbb1b76-4f4c-42fa-813d-176ad06626d8 already deleted. [ 1037.808409] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3cbb1b76-4f4c-42fa-813d-176ad06626d8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.899941] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.900123] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.900166] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.900919] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.900919] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.915220] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca55d9c7-11be-476b-bdb5-63e4c956a4de in Status: IN_PROGRESS for 2s [ 1037.960412] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4e54f39e-349d-49ad-bb07-348488d846f0',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.018583] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.018761] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.018828] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.019072] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.019170] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.019378] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.019499] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.019568] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.019722] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.019799] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.019890] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d141340f-d099-4b67-88b0-348423856ab2 is going to be updated. [ 1038.088786] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.088907] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.088907] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.089239] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.089490] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.102958] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d141340f-d099-4b67-88b0-348423856ab2 in Status: IN_PROGRESS for 2s [ 1038.345183] env[70614]: INFO networking_nsxv3.common.synchronization [req-53d1d33c-557e-44e0-bdd4-45ab7bba8d1a req-d26e65c6-40dd-4a05-97d5-03d329b3843f tempest-ServerPasswordTestJSON-360226754 tempest-ServerPasswordTestJSON-360226754-project-member] Enqueued Resource ID: 7ea2558c-aa82-4694-8be9-307b8ca3e536 with Priority: HIGHEST for action security_group_members [ 1038.345768] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ea2558c-aa82-4694-8be9-307b8ca3e536 with Priority: HIGHEST for action security_group_members [ 1038.346089] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ea2558c-aa82-4694-8be9-307b8ca3e536 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.346217] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ea2558c-aa82-4694-8be9-307b8ca3e536" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.346276] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ea2558c-aa82-4694-8be9-307b8ca3e536" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.346482] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ea2558c-aa82-4694-8be9-307b8ca3e536" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.346633] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.346734] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.346796] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.346956] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.347058] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.347122] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ea2558c-aa82-4694-8be9-307b8ca3e536',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.405208] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-805 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.405208] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-805" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.405208] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-805" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.405208] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-805" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.405484] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.405627] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.405792] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.405965] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.406401] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.408475] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1038.408475] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1038.408475] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1038.408475] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1038.408475] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1038.408475] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1038.408475] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1038.439823] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1038.439992] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1038.440155] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1038.440363] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-805" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.440687] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-0b5013ba-e41d-4974-a768-bb9a8295245b taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.440868] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-0b5013ba-e41d-4974-a768-bb9a8295245b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.440994] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-0b5013ba-e41d-4974-a768-bb9a8295245b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.441358] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-0b5013ba-e41d-4974-a768-bb9a8295245b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.441504] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b5013ba-e41d-4974-a768-bb9a8295245b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.464653] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.464814] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.465042] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.465109] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.465158] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.465263] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e54f39e-349d-49ad-bb07-348488d846f0 is going to be updated. [ 1038.511543] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.511700] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.511863] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.513560] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.513560] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.525454] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e54f39e-349d-49ad-bb07-348488d846f0 in Status: IN_PROGRESS for 2s [ 1038.586290] env[70614]: INFO networking_nsxv3.common.synchronization [None req-0d273b81-338e-4639-b870-3ba3df6f3ccf tempest-ServerActionsV293TestJSON-1550365301 tempest-ServerActionsV293TestJSON-1550365301-project-member] Enqueued Resource ID: ced2222f-152a-4951-8da3-65259a9e32af with Priority: HIGHEST for action security_group_rules [ 1038.586877] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ced2222f-152a-4951-8da3-65259a9e32af with Priority: HIGHEST for action security_group_rules [ 1038.587211] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ced2222f-152a-4951-8da3-65259a9e32af taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.587326] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ced2222f-152a-4951-8da3-65259a9e32af" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.587398] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ced2222f-152a-4951-8da3-65259a9e32af" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.587759] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ced2222f-152a-4951-8da3-65259a9e32af" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.587858] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ced2222f-152a-4951-8da3-65259a9e32af',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.677593] env[70614]: INFO networking_nsxv3.common.synchronization [None req-b03b6be1-c5e4-453b-90cf-b62070a81cf5 tempest-ServerActionsV293TestJSON-1550365301 tempest-ServerActionsV293TestJSON-1550365301-project-member] Enqueued Resource ID: ced2222f-152a-4951-8da3-65259a9e32af with Priority: HIGHEST for action security_group_rules [ 1038.678348] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ced2222f-152a-4951-8da3-65259a9e32af with Priority: HIGHEST for action security_group_rules [ 1038.678696] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ced2222f-152a-4951-8da3-65259a9e32af taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.678829] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ced2222f-152a-4951-8da3-65259a9e32af" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.850362] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.850708] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.850708] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.850845] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.850995] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.851306] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.851434] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.851504] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.851792] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.851905] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.852082] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ea2558c-aa82-4694-8be9-307b8ca3e536 is going to be updated. [ 1038.891098] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.891221] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.891221] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.891446] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.891606] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.902695] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ea2558c-aa82-4694-8be9-307b8ca3e536 in Status: IN_PROGRESS for 2s [ 1038.950195] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.950195] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.950195] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.950195] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.950195] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.950195] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 0b5013ba-e41d-4974-a768-bb9a8295245b not found, creating... [ 1038.950195] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.950195] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.950195] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.950695] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.950695] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.951055] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.951328] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.951524] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.951873] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.952089] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.952216] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 0b5013ba-e41d-4974-a768-bb9a8295245b is going to be created. [ 1038.976543] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.976951] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.977215] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.977677] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.980926] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.981491] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-0b5013ba-e41d-4974-a768-bb9a8295245b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.128034] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.128034] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.128034] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.128034] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.128034] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.128034] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ced2222f-152a-4951-8da3-65259a9e32af already deleted. [ 1039.128034] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ced2222f-152a-4951-8da3-65259a9e32af" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.128034] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ced2222f-152a-4951-8da3-65259a9e32af" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.128034] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ced2222f-152a-4951-8da3-65259a9e32af" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.128034] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ced2222f-152a-4951-8da3-65259a9e32af',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.313162] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77b7addf-0db2-4091-a32b-1272c6ac49b5 in Status: SUCCESS [ 1039.314433] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77b7addf-0db2-4091-a32b-1272c6ac49b5 deletion is rescheduled due to dependency. [ 1039.314433] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77b7addf-0db2-4091-a32b-1272c6ac49b5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.648686] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.649621] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.649792] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.650156] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.650343] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.650538] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ced2222f-152a-4951-8da3-65259a9e32af already deleted. [ 1039.650993] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ced2222f-152a-4951-8da3-65259a9e32af" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.857669] env[70614]: INFO networking_nsxv3.common.synchronization [None req-715f3854-968d-4012-916a-95d08ef54f6f None None] Enqueued Resource ID: d147bc79-9671-4c5e-91c2-4b8e5cee7bba with Priority: HIGHEST for action port [ 1039.858383] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d147bc79-9671-4c5e-91c2-4b8e5cee7bba with Priority: HIGHEST for action port [ 1039.858839] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-d147bc79-9671-4c5e-91c2-4b8e5cee7bba taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.859230] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d147bc79-9671-4c5e-91c2-4b8e5cee7bba" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.859375] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d147bc79-9671-4c5e-91c2-4b8e5cee7bba" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.859733] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d147bc79-9671-4c5e-91c2-4b8e5cee7bba" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.859891] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d147bc79-9671-4c5e-91c2-4b8e5cee7bba',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.932877] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca55d9c7-11be-476b-bdb5-63e4c956a4de in Status: SUCCESS [ 1039.933183] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca55d9c7-11be-476b-bdb5-63e4c956a4de" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.995590] env[70614]: INFO networking_nsxv3.common.synchronization [req-50f976d1-e324-446b-8359-6e14b52795f2 req-5f8ddb14-866a-47a2-8233-16a6088155de tempest-MultipleCreateTestJSON-983295494 tempest-MultipleCreateTestJSON-983295494-project-member] Enqueued Resource ID: d141340f-d099-4b67-88b0-348423856ab2 with Priority: HIGHEST for action security_group_members [ 1039.996494] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d141340f-d099-4b67-88b0-348423856ab2 with Priority: HIGHEST for action security_group_members [ 1039.996851] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-d141340f-d099-4b67-88b0-348423856ab2 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.997173] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.999178] env[70614]: INFO networking_nsxv3.common.synchronization [req-8af0b3ce-9915-4065-adc6-e20901697834 req-e04257b5-136b-4cf7-b2fc-4d345af44b41 tempest-ServerActionsTestOtherA-302418031 tempest-ServerActionsTestOtherA-302418031-project-member] Enqueued Resource ID: ad8b8cdd-7eee-48c2-8c33-7b83fde75038 with Priority: HIGHEST for action security_group_members [ 1039.999427] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad8b8cdd-7eee-48c2-8c33-7b83fde75038 with Priority: HIGHEST for action security_group_members [ 1039.999994] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad8b8cdd-7eee-48c2-8c33-7b83fde75038 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.000116] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad8b8cdd-7eee-48c2-8c33-7b83fde75038" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.000185] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad8b8cdd-7eee-48c2-8c33-7b83fde75038" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.000412] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad8b8cdd-7eee-48c2-8c33-7b83fde75038" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.000585] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.000687] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.000750] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.000905] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.000991] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.002664] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad8b8cdd-7eee-48c2-8c33-7b83fde75038',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.103083] env[70614]: INFO networking_nsxv3.common.synchronization [req-50f976d1-e324-446b-8359-6e14b52795f2 req-a2999507-3655-41d4-b0c0-fd17b9469735 service nova] Enqueued Resource ID: d141340f-d099-4b67-88b0-348423856ab2 with Priority: HIGHEST for action security_group_rules [ 1040.103083] env[70614]: INFO networking_nsxv3.common.synchronization [req-50f976d1-e324-446b-8359-6e14b52795f2 req-a2999507-3655-41d4-b0c0-fd17b9469735 service nova] Enqueued Resource ID: d141340f-d099-4b67-88b0-348423856ab2 with Priority: HIGHEST for action security_group_members [ 1040.103083] env[70614]: INFO networking_nsxv3.common.synchronization [req-50f976d1-e324-446b-8359-6e14b52795f2 req-a2999507-3655-41d4-b0c0-fd17b9469735 service nova] Enqueued Resource ID: 0b5013ba-e41d-4974-a768-bb9a8295245b with Priority: HIGHEST for action port [ 1040.104490] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d141340f-d099-4b67-88b0-348423856ab2 with Priority: HIGHEST for action security_group_rules [ 1040.104736] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d141340f-d099-4b67-88b0-348423856ab2 with Priority: HIGHEST for action security_group_members [ 1040.107549] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b5013ba-e41d-4974-a768-bb9a8295245b with Priority: HIGHEST for action port [ 1040.107942] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d141340f-d099-4b67-88b0-348423856ab2 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.108121] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.108168] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.108454] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.108581] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d141340f-d099-4b67-88b0-348423856ab2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.110573] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-d141340f-d099-4b67-88b0-348423856ab2 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.111045] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.112422] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-0b5013ba-e41d-4974-a768-bb9a8295245b taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.112556] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0b5013ba-e41d-4974-a768-bb9a8295245b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.112607] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0b5013ba-e41d-4974-a768-bb9a8295245b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.112821] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0b5013ba-e41d-4974-a768-bb9a8295245b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.112907] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b5013ba-e41d-4974-a768-bb9a8295245b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.123364] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d141340f-d099-4b67-88b0-348423856ab2 in Status: SUCCESS [ 1040.123364] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d141340f-d099-4b67-88b0-348423856ab2 deletion is rescheduled due to dependency. [ 1040.123364] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.123364] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.123632] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.123709] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.123894] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.123967] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.124157] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.124296] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.124461] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d141340f-d099-4b67-88b0-348423856ab2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.361848] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d147bc79-9671-4c5e-91c2-4b8e5cee7bba [ 1040.362411] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.362722] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.363500] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.363500] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.363500] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.363500] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d147bc79-9671-4c5e-91c2-4b8e5cee7bba already deleted. [ 1040.363500] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d147bc79-9671-4c5e-91c2-4b8e5cee7bba" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.507952] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.507952] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.507952] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.507952] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.507952] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.507952] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.507952] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.507952] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.507952] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.507952] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.507952] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad8b8cdd-7eee-48c2-8c33-7b83fde75038 is going to be updated. [ 1040.523021] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-805 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.523021] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-805" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.523021] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-805" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.523021] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-805" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.523021] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.523021] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.523021] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.523021] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.523021] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.523021] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1040.523765] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1040.523996] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1040.524074] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1040.524201] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1040.524316] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1040.524460] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1040.538090] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e54f39e-349d-49ad-bb07-348488d846f0 in Status: SUCCESS [ 1040.538312] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.539644] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.539644] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.539644] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.539644] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.539644] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.539644] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.539644] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.539644] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.539644] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4e54f39e-349d-49ad-bb07-348488d846f0',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.542333] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.542476] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.542585] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.545125] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.545125] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.546473] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1040.546665] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1040.546839] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1040.547035] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-805" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.547378] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-823a7ec1-8297-4679-863f-d608ee7d7d44 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.547584] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-823a7ec1-8297-4679-863f-d608ee7d7d44" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.548023] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-823a7ec1-8297-4679-863f-d608ee7d7d44" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.548421] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-823a7ec1-8297-4679-863f-d608ee7d7d44" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.548661] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('823a7ec1-8297-4679-863f-d608ee7d7d44',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.563659] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad8b8cdd-7eee-48c2-8c33-7b83fde75038 in Status: IN_PROGRESS for 2s [ 1040.614488] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-d141340f-d099-4b67-88b0-348423856ab2 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.614619] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.614818] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0b5013ba-e41d-4974-a768-bb9a8295245b with status ACTIVE [ 1040.614985] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.615103] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.615168] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.617492] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.618283] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.618283] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.618283] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.618283] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.618579] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.619432] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.619432] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.619432] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.619432] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.619432] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.619432] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.619901] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0b5013ba-e41d-4974-a768-bb9a8295245b is going to be updated. [ 1040.627429] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d141340f-d099-4b67-88b0-348423856ab2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.642053] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.642317] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.642317] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.642462] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.642607] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.642776] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0b5013ba-e41d-4974-a768-bb9a8295245b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.916869] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ea2558c-aa82-4694-8be9-307b8ca3e536 in Status: SUCCESS [ 1040.917275] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ea2558c-aa82-4694-8be9-307b8ca3e536 deletion is rescheduled due to dependency. [ 1040.917275] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ea2558c-aa82-4694-8be9-307b8ca3e536" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.045832] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4e54f39e-349d-49ad-bb07-348488d846f0',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.051188] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.051469] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.051671] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.051922] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.052108] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.052264] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 823a7ec1-8297-4679-863f-d608ee7d7d44 not found, creating... [ 1041.052544] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.052707] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.052825] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.053074] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.053218] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.053512] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.053670] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.053787] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.054007] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.054162] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.054299] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 823a7ec1-8297-4679-863f-d608ee7d7d44 is going to be created. [ 1041.081270] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.081505] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.081639] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.081939] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.082210] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.082446] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-823a7ec1-8297-4679-863f-d608ee7d7d44" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.131111] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d141340f-d099-4b67-88b0-348423856ab2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.549028] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4e54f39e-349d-49ad-bb07-348488d846f0: rpc.has_security_group_logging(os_id): False [ 1041.568243] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.568243] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.568243] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.568243] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.568243] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.568243] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.568243] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.568243] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.568243] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.568243] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.568243] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e54f39e-349d-49ad-bb07-348488d846f0 is going to be updated. [ 1041.633024] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.633024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.633024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.633024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.633024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.633620] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.633912] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.634930] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.634930] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.634930] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.634930] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d141340f-d099-4b67-88b0-348423856ab2 is going to be updated. [ 1041.662724] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e54f39e-349d-49ad-bb07-348488d846f0 in Status: IN_PROGRESS for 2s [ 1041.701734] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.701734] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.701734] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.701734] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.701734] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.725681] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d141340f-d099-4b67-88b0-348423856ab2 in Status: IN_PROGRESS for 2s [ 1041.806820] env[70614]: INFO networking_nsxv3.common.synchronization [req-50f976d1-e324-446b-8359-6e14b52795f2 req-d1bde1e5-647b-4b7c-9615-bd8cc26f3f21 service nova] Enqueued Resource ID: d141340f-d099-4b67-88b0-348423856ab2 with Priority: HIGHEST for action security_group_rules [ 1041.807315] env[70614]: INFO networking_nsxv3.common.synchronization [req-50f976d1-e324-446b-8359-6e14b52795f2 req-d1bde1e5-647b-4b7c-9615-bd8cc26f3f21 service nova] Enqueued Resource ID: d141340f-d099-4b67-88b0-348423856ab2 with Priority: HIGHEST for action security_group_members [ 1041.809279] env[70614]: INFO networking_nsxv3.common.synchronization [req-50f976d1-e324-446b-8359-6e14b52795f2 req-d1bde1e5-647b-4b7c-9615-bd8cc26f3f21 service nova] Enqueued Resource ID: 823a7ec1-8297-4679-863f-d608ee7d7d44 with Priority: HIGHEST for action port [ 1041.812202] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d141340f-d099-4b67-88b0-348423856ab2 with Priority: HIGHEST for action security_group_rules [ 1041.812202] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d141340f-d099-4b67-88b0-348423856ab2 with Priority: HIGHEST for action security_group_members [ 1041.812202] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 823a7ec1-8297-4679-863f-d608ee7d7d44 with Priority: HIGHEST for action port [ 1041.812202] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d141340f-d099-4b67-88b0-348423856ab2 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.812202] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.812202] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-d141340f-d099-4b67-88b0-348423856ab2 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.812202] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.812202] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-823a7ec1-8297-4679-863f-d608ee7d7d44 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.812202] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-823a7ec1-8297-4679-863f-d608ee7d7d44" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.812202] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-823a7ec1-8297-4679-863f-d608ee7d7d44" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.812202] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-823a7ec1-8297-4679-863f-d608ee7d7d44" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.812202] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('823a7ec1-8297-4679-863f-d608ee7d7d44',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.315898] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 823a7ec1-8297-4679-863f-d608ee7d7d44 with status ACTIVE [ 1042.316286] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.316456] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.316559] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.317300] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.317300] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.317300] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.317640] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.317640] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.317753] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.317851] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.318141] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.318278] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.318367] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.318597] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.318684] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.318794] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 823a7ec1-8297-4679-863f-d608ee7d7d44 is going to be updated. [ 1042.346859] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.347117] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.347117] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.347294] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.347426] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.347609] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-823a7ec1-8297-4679-863f-d608ee7d7d44" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.575355] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad8b8cdd-7eee-48c2-8c33-7b83fde75038 in Status: SUCCESS [ 1042.575355] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad8b8cdd-7eee-48c2-8c33-7b83fde75038 deletion is rescheduled due to dependency. [ 1042.575355] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad8b8cdd-7eee-48c2-8c33-7b83fde75038" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.801896] env[70614]: INFO networking_nsxv3.common.synchronization [req-b18a4eca-aae4-4e7c-b1fe-bbbf2d3b08a4 req-30128053-2ba8-4f5e-be4b-9b4f3d0348be tempest-ImagesTestJSON-1765947257 tempest-ImagesTestJSON-1765947257-project-member] Enqueued Resource ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 with Priority: HIGHEST for action security_group_members [ 1042.802497] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 with Priority: HIGHEST for action security_group_members [ 1042.802807] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-04a082fe-52f7-4ac6-a12b-63791c63be86 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.802942] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.804081] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.804081] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.804081] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.804081] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.804081] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.804081] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.804081] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.804081] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04a082fe-52f7-4ac6-a12b-63791c63be86',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.309387] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.309387] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.309387] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.309387] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.309387] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.309387] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.309387] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.309387] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.309387] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.309387] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.309387] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 is going to be updated. [ 1043.347116] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.347116] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.347116] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.347116] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.347116] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.366071] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 in Status: IN_PROGRESS for 2s [ 1043.678337] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e54f39e-349d-49ad-bb07-348488d846f0 in Status: SUCCESS [ 1043.678337] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.739043] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d141340f-d099-4b67-88b0-348423856ab2 in Status: SUCCESS [ 1043.739043] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.739043] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.739043] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.739043] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.739043] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.739043] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.739043] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.739043] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.739043] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d141340f-d099-4b67-88b0-348423856ab2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.811876] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-12 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.812153] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-12" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.812291] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-12" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.812622] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-12" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.812868] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.813043] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.813164] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.813396] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.813546] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.814351] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1043.814541] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1043.814643] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1043.814721] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1043.814857] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1043.814969] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1043.815137] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1043.850875] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1043.852552] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1043.852552] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1043.852552] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-12" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.852552] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-2ef24367-252e-4f1e-9881-4ed343ac0d79 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.852552] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-2ef24367-252e-4f1e-9881-4ed343ac0d79" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.852552] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-2ef24367-252e-4f1e-9881-4ed343ac0d79" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.852552] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-2ef24367-252e-4f1e-9881-4ed343ac0d79" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.853242] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ef24367-252e-4f1e-9881-4ed343ac0d79',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.064562] env[70614]: INFO networking_nsxv3.common.synchronization [None req-2f042373-3944-4401-9c14-43d69acbb000 tempest-AttachInterfacesTestJSON-1919943007 tempest-AttachInterfacesTestJSON-1919943007-project-member] Enqueued Resource ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 with Priority: HIGHEST for action security_group_members [ 1044.065356] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 with Priority: HIGHEST for action security_group_members [ 1044.065724] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d3a5ad0-c473-4d61-9101-9c7582c27390 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.065885] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.065978] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.066173] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.066335] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.066451] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.066509] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.066678] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.066774] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.066864] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d3a5ad0-c473-4d61-9101-9c7582c27390',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.241366] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d141340f-d099-4b67-88b0-348423856ab2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.355895] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.356458] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.356458] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.356596] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.356684] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.356801] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 2ef24367-252e-4f1e-9881-4ed343ac0d79 not found, creating... [ 1044.357089] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.357250] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.357374] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.357603] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.357746] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.358054] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.358219] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.358337] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.358580] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.358730] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.358879] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 2ef24367-252e-4f1e-9881-4ed343ac0d79 is going to be created. [ 1044.386599] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.386818] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.386945] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.387251] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.387494] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.387723] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-2ef24367-252e-4f1e-9881-4ed343ac0d79" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.572228] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.572418] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.572522] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.572752] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.572847] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.573064] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.573164] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.573225] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.573376] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.573451] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.573540] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 is going to be updated. [ 1044.604660] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.604877] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.604877] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.605479] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.605479] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.615546] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 in Status: IN_PROGRESS for 2s [ 1044.744615] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d141340f-d099-4b67-88b0-348423856ab2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.247066] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.247356] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.247356] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.247544] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.251025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.251025] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d141340f-d099-4b67-88b0-348423856ab2 is going to be updated. [ 1045.297412] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.297630] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.297630] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.297914] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.298104] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.314955] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d141340f-d099-4b67-88b0-348423856ab2 in Status: IN_PROGRESS for 2s [ 1045.380379] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 in Status: SUCCESS [ 1045.380777] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 deletion is rescheduled due to dependency. [ 1045.380777] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.782080] env[70614]: INFO networking_nsxv3.common.synchronization [req-b18a4eca-aae4-4e7c-b1fe-bbbf2d3b08a4 req-0fad3f37-37a6-4e7d-a225-9fe7cb1ab229 service nova] Enqueued Resource ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 with Priority: HIGHEST for action security_group_rules [ 1045.782080] env[70614]: INFO networking_nsxv3.common.synchronization [req-b18a4eca-aae4-4e7c-b1fe-bbbf2d3b08a4 req-0fad3f37-37a6-4e7d-a225-9fe7cb1ab229 service nova] Enqueued Resource ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 with Priority: HIGHEST for action security_group_members [ 1045.782080] env[70614]: INFO networking_nsxv3.common.synchronization [req-b18a4eca-aae4-4e7c-b1fe-bbbf2d3b08a4 req-0fad3f37-37a6-4e7d-a225-9fe7cb1ab229 service nova] Enqueued Resource ID: 2ef24367-252e-4f1e-9881-4ed343ac0d79 with Priority: HIGHEST for action port [ 1045.782080] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 with Priority: HIGHEST for action security_group_rules [ 1045.782080] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 with Priority: HIGHEST for action security_group_members [ 1045.782080] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ef24367-252e-4f1e-9881-4ed343ac0d79 with Priority: HIGHEST for action port [ 1045.782080] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-04a082fe-52f7-4ac6-a12b-63791c63be86 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.782080] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.782080] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.783551] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.784963] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('04a082fe-52f7-4ac6-a12b-63791c63be86',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.786409] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-04a082fe-52f7-4ac6-a12b-63791c63be86 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.786719] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.787971] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.787971] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.787971] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.787971] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.787971] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.787971] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.788326] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.788326] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04a082fe-52f7-4ac6-a12b-63791c63be86',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.790340] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-2ef24367-252e-4f1e-9881-4ed343ac0d79 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.790511] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2ef24367-252e-4f1e-9881-4ed343ac0d79" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.790613] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2ef24367-252e-4f1e-9881-4ed343ac0d79" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.790970] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2ef24367-252e-4f1e-9881-4ed343ac0d79" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.792706] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ef24367-252e-4f1e-9881-4ed343ac0d79',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.295146] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('04a082fe-52f7-4ac6-a12b-63791c63be86',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.296918] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-04a082fe-52f7-4ac6-a12b-63791c63be86 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.297092] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.297250] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2ef24367-252e-4f1e-9881-4ed343ac0d79 with status ACTIVE [ 1046.297891] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.297891] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.297891] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.297891] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.297891] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.298287] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.298287] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.298287] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.298474] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.298474] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.298579] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.298661] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.298721] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.298859] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.298922] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.299030] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2ef24367-252e-4f1e-9881-4ed343ac0d79 is going to be updated. [ 1046.332207] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.332356] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.332429] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.332649] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.332790] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.332953] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2ef24367-252e-4f1e-9881-4ed343ac0d79" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.629723] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 in Status: SUCCESS [ 1046.630128] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 deletion is rescheduled due to dependency. [ 1046.630128] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.803247] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('04a082fe-52f7-4ac6-a12b-63791c63be86',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.307313] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.307650] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.307747] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.308058] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.308123] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.308225] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 is going to be updated. [ 1047.326969] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d141340f-d099-4b67-88b0-348423856ab2 in Status: SUCCESS [ 1047.327276] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.327464] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.327748] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.328046] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.328178] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.328278] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.328473] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.328617] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.328722] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.328825] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d141340f-d099-4b67-88b0-348423856ab2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.330204] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.330408] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.330608] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.330690] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.330745] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.330905] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.330985] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.331090] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d141340f-d099-4b67-88b0-348423856ab2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.348833] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.348833] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.349022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.349190] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.349341] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.359474] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 in Status: IN_PROGRESS for 2s [ 1047.836028] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-d141340f-d099-4b67-88b0-348423856ab2 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.836028] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.836028] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d141340f-d099-4b67-88b0-348423856ab2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.338216] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d141340f-d099-4b67-88b0-348423856ab2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.844036] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.844036] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.844036] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.844036] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.844036] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.844036] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d141340f-d099-4b67-88b0-348423856ab2 is going to be updated. [ 1048.886622] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.886813] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.886900] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.887168] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.887328] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.900591] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d141340f-d099-4b67-88b0-348423856ab2 in Status: IN_PROGRESS for 2s [ 1049.372558] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 in Status: SUCCESS [ 1049.372558] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.372840] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.373317] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.373690] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.373937] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.374248] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.374547] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.374666] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.374767] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.374867] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('04a082fe-52f7-4ac6-a12b-63791c63be86',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.884423] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-04a082fe-52f7-4ac6-a12b-63791c63be86 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.884836] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.884836] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.885803] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.885803] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.885803] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.885803] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.885803] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.886152] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.886152] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.886236] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-04a082fe-52f7-4ac6-a12b-63791c63be86 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.886286] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.886381] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.886588] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.886850] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.886922] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.887110] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.888172] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.890479] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.890479] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.890479] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('04a082fe-52f7-4ac6-a12b-63791c63be86',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.033362] env[70614]: INFO networking_nsxv3.common.synchronization [None req-395301e4-9eda-4bf3-ab7f-4a00ba36c153 tempest-ServerActionsTestOtherA-302418031 tempest-ServerActionsTestOtherA-302418031-project-member] Enqueued Resource ID: 28809bb1-c80b-4696-9980-5f00f47130bb with Priority: HIGHEST for action security_group_rules [ 1050.037097] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28809bb1-c80b-4696-9980-5f00f47130bb with Priority: HIGHEST for action security_group_rules [ 1050.038127] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-28809bb1-c80b-4696-9980-5f00f47130bb taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.038345] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-28809bb1-c80b-4696-9980-5f00f47130bb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.038435] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-28809bb1-c80b-4696-9980-5f00f47130bb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.038757] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-28809bb1-c80b-4696-9980-5f00f47130bb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.039031] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('28809bb1-c80b-4696-9980-5f00f47130bb',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.180346] env[70614]: INFO networking_nsxv3.common.synchronization [None req-18402547-08d6-4295-ad8a-5f434c32b82d tempest-ServerActionsTestOtherA-302418031 tempest-ServerActionsTestOtherA-302418031-project-member] Enqueued Resource ID: 28809bb1-c80b-4696-9980-5f00f47130bb with Priority: HIGHEST for action security_group_rules [ 1050.185868] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28809bb1-c80b-4696-9980-5f00f47130bb with Priority: HIGHEST for action security_group_rules [ 1050.186382] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-28809bb1-c80b-4696-9980-5f00f47130bb taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.186556] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-28809bb1-c80b-4696-9980-5f00f47130bb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.390912] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 04a082fe-52f7-4ac6-a12b-63791c63be86: rpc.has_security_group_logging(os_id): False [ 1050.410433] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.410666] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.410750] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.410964] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.411073] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.411299] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.411402] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.411620] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.411620] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.411728] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.411909] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.412024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.412024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.412736] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.412900] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.413443] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.413549] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.413755] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.413910] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.413910] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.414094] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 is going to be updated. [ 1050.492182] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.492383] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.492450] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.492861] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.492960] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.511145] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 in Status: IN_PROGRESS for 2s [ 1050.569070] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.571347] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.571347] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.571347] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.571347] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.571347] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 28809bb1-c80b-4696-9980-5f00f47130bb already deleted. [ 1050.571347] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-28809bb1-c80b-4696-9980-5f00f47130bb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.571347] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-28809bb1-c80b-4696-9980-5f00f47130bb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.571347] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-28809bb1-c80b-4696-9980-5f00f47130bb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.571347] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('28809bb1-c80b-4696-9980-5f00f47130bb',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.922032] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d141340f-d099-4b67-88b0-348423856ab2 in Status: SUCCESS [ 1050.922652] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.922652] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.922753] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.922949] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.923090] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.923160] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.923388] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.923498] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.923592] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.923765] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-d141340f-d099-4b67-88b0-348423856ab2 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.923885] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.923946] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.924343] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.924497] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.924595] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.924654] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.924802] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.924880] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.924964] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.925071] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d141340f-d099-4b67-88b0-348423856ab2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.105251] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.105934] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.105934] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.105934] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.106276] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.106276] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 28809bb1-c80b-4696-9980-5f00f47130bb already deleted. [ 1051.106833] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-28809bb1-c80b-4696-9980-5f00f47130bb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.343383] env[70614]: INFO networking_nsxv3.common.synchronization [req-e55d9b9d-f0b4-43ba-a2e2-13bc1ca12c11 req-32a13ac0-b96b-4ea3-98bb-2a90898bd006 tempest-ServersTestBootFromVolume-917450361 tempest-ServersTestBootFromVolume-917450361-project-member] Enqueued Resource ID: 45904912-7759-4b89-83ba-2a95c86ca5fd with Priority: HIGHEST for action security_group_members [ 1051.343987] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45904912-7759-4b89-83ba-2a95c86ca5fd with Priority: HIGHEST for action security_group_members [ 1051.344314] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-45904912-7759-4b89-83ba-2a95c86ca5fd taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.344428] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45904912-7759-4b89-83ba-2a95c86ca5fd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.344489] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45904912-7759-4b89-83ba-2a95c86ca5fd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.344759] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45904912-7759-4b89-83ba-2a95c86ca5fd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.344915] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.348123] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.348311] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.348432] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.348524] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.348629] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45904912-7759-4b89-83ba-2a95c86ca5fd',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.428023] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d141340f-d099-4b67-88b0-348423856ab2: rpc.has_security_group_logging(os_id): False [ 1051.450302] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.450302] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.450302] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.451613] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.451613] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.451613] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.451613] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.451613] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.451613] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.451613] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.451613] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.452086] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.452086] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.452086] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.452086] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.455942] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.455942] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.456185] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.457059] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.457059] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.457059] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d141340f-d099-4b67-88b0-348423856ab2 is going to be updated. [ 1051.538703] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.538899] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.538993] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.539299] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.539602] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.559588] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d141340f-d099-4b67-88b0-348423856ab2 in Status: IN_PROGRESS for 2s [ 1051.851778] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.852079] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.852154] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.852382] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.852494] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.852754] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.852843] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.852990] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.853141] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.853211] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.853280] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45904912-7759-4b89-83ba-2a95c86ca5fd already deleted. [ 1051.853375] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45904912-7759-4b89-83ba-2a95c86ca5fd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.931061] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-794 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.931711] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-794" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.932670] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-794" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.933021] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-794" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.933308] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.933500] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.933626] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.933920] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.934603] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.934603] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1051.934603] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1051.934840] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1051.934840] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1051.934955] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1051.935022] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1051.935215] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1051.958893] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1051.958893] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1051.958893] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1051.958893] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-794" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.959269] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-f8476dd9-f595-4c46-a26b-7582cd0b60d7 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.959609] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-f8476dd9-f595-4c46-a26b-7582cd0b60d7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.959609] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-f8476dd9-f595-4c46-a26b-7582cd0b60d7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.960683] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-f8476dd9-f595-4c46-a26b-7582cd0b60d7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.960683] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8476dd9-f595-4c46-a26b-7582cd0b60d7',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.467305] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.467585] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.467707] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.467999] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.468171] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.468331] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port f8476dd9-f595-4c46-a26b-7582cd0b60d7 not found, creating... [ 1052.469062] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.469062] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.469062] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.469367] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.469367] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.469575] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.470226] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.470226] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.471752] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.471752] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.471752] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: f8476dd9-f595-4c46-a26b-7582cd0b60d7 is going to be created. [ 1052.493029] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.493252] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.493791] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.493791] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.493916] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.494116] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-f8476dd9-f595-4c46-a26b-7582cd0b60d7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.530817] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 in Status: SUCCESS [ 1052.530817] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.271040] env[70614]: INFO networking_nsxv3.common.synchronization [req-e55d9b9d-f0b4-43ba-a2e2-13bc1ca12c11 req-fbf6bb31-f7d6-40b5-b050-942b4dd386d1 service nova] Enqueued Resource ID: 45904912-7759-4b89-83ba-2a95c86ca5fd with Priority: HIGHEST for action security_group_rules [ 1053.271332] env[70614]: INFO networking_nsxv3.common.synchronization [req-e55d9b9d-f0b4-43ba-a2e2-13bc1ca12c11 req-fbf6bb31-f7d6-40b5-b050-942b4dd386d1 service nova] Enqueued Resource ID: 45904912-7759-4b89-83ba-2a95c86ca5fd with Priority: HIGHEST for action security_group_members [ 1053.271378] env[70614]: INFO networking_nsxv3.common.synchronization [req-e55d9b9d-f0b4-43ba-a2e2-13bc1ca12c11 req-fbf6bb31-f7d6-40b5-b050-942b4dd386d1 service nova] Enqueued Resource ID: f8476dd9-f595-4c46-a26b-7582cd0b60d7 with Priority: HIGHEST for action port [ 1053.272572] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45904912-7759-4b89-83ba-2a95c86ca5fd with Priority: HIGHEST for action security_group_rules [ 1053.272740] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45904912-7759-4b89-83ba-2a95c86ca5fd with Priority: HIGHEST for action security_group_members [ 1053.272875] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8476dd9-f595-4c46-a26b-7582cd0b60d7 with Priority: HIGHEST for action port [ 1053.273323] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45904912-7759-4b89-83ba-2a95c86ca5fd taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.273501] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45904912-7759-4b89-83ba-2a95c86ca5fd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.273595] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45904912-7759-4b89-83ba-2a95c86ca5fd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.276104] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45904912-7759-4b89-83ba-2a95c86ca5fd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.276104] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45904912-7759-4b89-83ba-2a95c86ca5fd',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.276104] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-45904912-7759-4b89-83ba-2a95c86ca5fd taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.276104] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45904912-7759-4b89-83ba-2a95c86ca5fd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.276104] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45904912-7759-4b89-83ba-2a95c86ca5fd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.276104] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45904912-7759-4b89-83ba-2a95c86ca5fd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.276104] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.276466] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.276617] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.279828] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.279828] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.279828] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45904912-7759-4b89-83ba-2a95c86ca5fd',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.280205] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-f8476dd9-f595-4c46-a26b-7582cd0b60d7 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.280205] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f8476dd9-f595-4c46-a26b-7582cd0b60d7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.280205] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f8476dd9-f595-4c46-a26b-7582cd0b60d7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.280446] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f8476dd9-f595-4c46-a26b-7582cd0b60d7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.280446] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8476dd9-f595-4c46-a26b-7582cd0b60d7',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.574508] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d141340f-d099-4b67-88b0-348423856ab2 in Status: SUCCESS [ 1053.574799] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.575049] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.575166] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.575243] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d141340f-d099-4b67-88b0-348423856ab2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.782685] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-45904912-7759-4b89-83ba-2a95c86ca5fd taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.782685] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45904912-7759-4b89-83ba-2a95c86ca5fd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.782888] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('45904912-7759-4b89-83ba-2a95c86ca5fd',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.784375] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f8476dd9-f595-4c46-a26b-7582cd0b60d7 with status ACTIVE [ 1053.784600] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.784684] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.784684] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.785869] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.785869] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.785869] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.785869] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.785869] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.786176] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.786213] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.786407] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.786491] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.786562] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.786706] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.786777] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.786861] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f8476dd9-f595-4c46-a26b-7582cd0b60d7 is going to be updated. [ 1053.811559] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.811758] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.811810] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.812256] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.812451] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.812653] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f8476dd9-f595-4c46-a26b-7582cd0b60d7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.945187] env[70614]: INFO networking_nsxv3.common.synchronization [req-13e015d5-0d79-4cae-b22f-318b332d3912 req-01fc25aa-fc5e-4226-ae77-d0adf9838c6f tempest-MultipleCreateTestJSON-983295494 tempest-MultipleCreateTestJSON-983295494-project-member] Enqueued Resource ID: d141340f-d099-4b67-88b0-348423856ab2 with Priority: HIGHEST for action security_group_members [ 1053.945729] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d141340f-d099-4b67-88b0-348423856ab2 with Priority: HIGHEST for action security_group_members [ 1053.946044] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-d141340f-d099-4b67-88b0-348423856ab2 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.946172] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.946238] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.946447] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.946600] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.946698] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.946759] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.946905] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.946990] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.947289] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d141340f-d099-4b67-88b0-348423856ab2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.077986] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-d141340f-d099-4b67-88b0-348423856ab2 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.078231] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.289838] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('45904912-7759-4b89-83ba-2a95c86ca5fd',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.398428] env[70614]: INFO networking_nsxv3.common.synchronization [req-2f022cfa-96b4-4f30-a326-08e3d281ed1a req-22c9f51e-7623-4fc9-befd-dc3d8e2832ff tempest-MultipleCreateTestJSON-983295494 tempest-MultipleCreateTestJSON-983295494-project-member] Enqueued Resource ID: d141340f-d099-4b67-88b0-348423856ab2 with Priority: HIGHEST for action security_group_members [ 1054.398968] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d141340f-d099-4b67-88b0-348423856ab2 with Priority: HIGHEST for action security_group_members [ 1054.399357] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-d141340f-d099-4b67-88b0-348423856ab2 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.399450] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.453385] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d141340f-d099-4b67-88b0-348423856ab2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.697368] env[70614]: INFO networking_nsxv3.common.synchronization [req-e7e576d8-d949-498f-9c89-337f5e70596a req-eda32049-d337-4b81-884c-35364b0c8504 tempest-VolumesAdminNegativeTest-2045600642 tempest-VolumesAdminNegativeTest-2045600642-project-member] Enqueued Resource ID: b20ed1f0-7f46-40ac-882f-36a610d96a98 with Priority: HIGHEST for action security_group_members [ 1054.697970] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b20ed1f0-7f46-40ac-882f-36a610d96a98 with Priority: HIGHEST for action security_group_members [ 1054.698237] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-b20ed1f0-7f46-40ac-882f-36a610d96a98 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.698361] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b20ed1f0-7f46-40ac-882f-36a610d96a98" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.698755] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b20ed1f0-7f46-40ac-882f-36a610d96a98" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.698755] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b20ed1f0-7f46-40ac-882f-36a610d96a98" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.698755] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.698952] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.698952] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.699119] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.699231] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.699327] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b20ed1f0-7f46-40ac-882f-36a610d96a98',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.791934] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.792122] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.792202] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.792415] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.792505] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.792607] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45904912-7759-4b89-83ba-2a95c86ca5fd is going to be created. [ 1054.820341] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.821352] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.821352] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.821352] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.821352] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.833412] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45904912-7759-4b89-83ba-2a95c86ca5fd in Status: UNINITIALIZED for 2s [ 1054.957914] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d141340f-d099-4b67-88b0-348423856ab2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.201641] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.201984] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.201984] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.202124] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.202218] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.202422] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.202523] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.202612] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.202740] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.202871] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.202964] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b20ed1f0-7f46-40ac-882f-36a610d96a98 is going to be updated. [ 1055.267960] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.268188] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.268236] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.268817] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.268817] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.283414] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b20ed1f0-7f46-40ac-882f-36a610d96a98 in Status: IN_PROGRESS for 2s [ 1055.461567] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.461891] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.461891] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.462078] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.462178] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.462278] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d141340f-d099-4b67-88b0-348423856ab2 is going to be updated. [ 1055.497614] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.497915] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.497915] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.498126] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.498430] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.509401] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d141340f-d099-4b67-88b0-348423856ab2 in Status: IN_PROGRESS for 2s [ 1055.835205] env[70614]: INFO networking_nsxv3.common.synchronization [req-7011fdea-88f2-4b01-ac3f-c86e407329fe req-476e339e-3332-4e5b-a71c-1bcf3f7c7775 tempest-DeleteServersTestJSON-1690139659 tempest-DeleteServersTestJSON-1690139659-project-member] Enqueued Resource ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f with Priority: HIGHEST for action security_group_members [ 1055.835847] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f with Priority: HIGHEST for action security_group_members [ 1055.836245] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.836365] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.836436] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.836644] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.836795] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.836888] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.838399] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.838399] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.838399] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.838399] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df8f20f5-6e92-4ac4-bdd2-05863ac4905f',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.228898] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-707 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.229126] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-707" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.229261] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-707" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.229705] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-707" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.230011] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.230191] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.230314] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.230588] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.230747] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.230965] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1056.231100] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1056.231213] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1056.231326] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1056.231440] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1056.231548] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1056.231688] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1056.268544] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1056.268804] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1056.268902] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1056.269111] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-707" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.269462] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-0322b3d5-d5cb-4d42-b1b7-1c62b05b7666 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.269736] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-0322b3d5-d5cb-4d42-b1b7-1c62b05b7666" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.269876] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-0322b3d5-d5cb-4d42-b1b7-1c62b05b7666" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.270278] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-0322b3d5-d5cb-4d42-b1b7-1c62b05b7666" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.270432] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0322b3d5-d5cb-4d42-b1b7-1c62b05b7666',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.339812] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.340046] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.340106] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.340507] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.340693] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.340950] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.341067] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.341130] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.341303] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.341390] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.341467] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f is going to be updated. [ 1056.372114] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.372397] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.372503] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.372732] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.372890] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.383884] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f in Status: IN_PROGRESS for 2s [ 1056.773033] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.773548] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.773548] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.773863] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.774098] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.774300] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 0322b3d5-d5cb-4d42-b1b7-1c62b05b7666 not found, creating... [ 1056.774701] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.774985] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.775263] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.775605] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.775838] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.776883] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.776883] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.776883] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.776883] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.777899] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.777899] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 0322b3d5-d5cb-4d42-b1b7-1c62b05b7666 is going to be created. [ 1056.799814] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.800147] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.800290] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.800827] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.800987] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.801282] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-0322b3d5-d5cb-4d42-b1b7-1c62b05b7666" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.844082] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45904912-7759-4b89-83ba-2a95c86ca5fd in Status: SUCCESS [ 1056.844417] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45904912-7759-4b89-83ba-2a95c86ca5fd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.844539] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45904912-7759-4b89-83ba-2a95c86ca5fd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.844845] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45904912-7759-4b89-83ba-2a95c86ca5fd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.845079] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.845233] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.845287] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.845505] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.845566] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.845689] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45904912-7759-4b89-83ba-2a95c86ca5fd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.845784] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('45904912-7759-4b89-83ba-2a95c86ca5fd',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.294456] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b20ed1f0-7f46-40ac-882f-36a610d96a98 in Status: SUCCESS [ 1057.294658] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b20ed1f0-7f46-40ac-882f-36a610d96a98 deletion is rescheduled due to dependency. [ 1057.294750] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b20ed1f0-7f46-40ac-882f-36a610d96a98" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.348766] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('45904912-7759-4b89-83ba-2a95c86ca5fd',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.497423] env[70614]: INFO networking_nsxv3.common.synchronization [req-7011fdea-88f2-4b01-ac3f-c86e407329fe req-eba54f38-17cd-4282-9d0d-fcd457e7406d service nova] Enqueued Resource ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f with Priority: HIGHEST for action security_group_rules [ 1057.497646] env[70614]: INFO networking_nsxv3.common.synchronization [req-7011fdea-88f2-4b01-ac3f-c86e407329fe req-eba54f38-17cd-4282-9d0d-fcd457e7406d service nova] Enqueued Resource ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f with Priority: HIGHEST for action security_group_members [ 1057.497896] env[70614]: INFO networking_nsxv3.common.synchronization [req-7011fdea-88f2-4b01-ac3f-c86e407329fe req-eba54f38-17cd-4282-9d0d-fcd457e7406d service nova] Enqueued Resource ID: 0322b3d5-d5cb-4d42-b1b7-1c62b05b7666 with Priority: HIGHEST for action port [ 1057.498205] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f with Priority: HIGHEST for action security_group_rules [ 1057.498426] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f with Priority: HIGHEST for action security_group_members [ 1057.498506] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0322b3d5-d5cb-4d42-b1b7-1c62b05b7666 with Priority: HIGHEST for action port [ 1057.499139] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df8f20f5-6e92-4ac4-bdd2-05863ac4905f taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.499410] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.499410] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.499848] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.499983] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df8f20f5-6e92-4ac4-bdd2-05863ac4905f',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.501228] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.501375] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.501608] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-0322b3d5-d5cb-4d42-b1b7-1c62b05b7666 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.501761] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0322b3d5-d5cb-4d42-b1b7-1c62b05b7666" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.501846] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0322b3d5-d5cb-4d42-b1b7-1c62b05b7666" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.502081] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0322b3d5-d5cb-4d42-b1b7-1c62b05b7666" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.502194] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0322b3d5-d5cb-4d42-b1b7-1c62b05b7666',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.526895] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d141340f-d099-4b67-88b0-348423856ab2 in Status: SUCCESS [ 1057.527160] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.528438] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.528690] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.528920] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.529057] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.529123] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.529310] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.529916] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.529916] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.529916] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d141340f-d099-4b67-88b0-348423856ab2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.530723] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.530913] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.531145] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.531238] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.531307] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.531549] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.531549] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.531673] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d141340f-d099-4b67-88b0-348423856ab2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.852340] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 45904912-7759-4b89-83ba-2a95c86ca5fd: rpc.has_security_group_logging(os_id): False [ 1057.882468] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.882680] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.882680] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.882897] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.882989] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.883263] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.883367] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.883464] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.883603] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.883679] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.883768] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45904912-7759-4b89-83ba-2a95c86ca5fd is going to be created. [ 1057.964763] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.965084] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.965084] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.965314] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.965416] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.978869] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45904912-7759-4b89-83ba-2a95c86ca5fd in Status: IN_PROGRESS for 2s [ 1058.004530] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.004724] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.007046] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0322b3d5-d5cb-4d42-b1b7-1c62b05b7666 with status ACTIVE [ 1058.007297] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.007415] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.007649] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.007917] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.008025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.008234] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.008350] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.008442] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.008672] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.008839] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.012175] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.012175] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.012175] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.012175] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.012175] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.012175] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0322b3d5-d5cb-4d42-b1b7-1c62b05b7666 is going to be updated. [ 1058.034251] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-d141340f-d099-4b67-88b0-348423856ab2 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.034509] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.034672] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.034783] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.034846] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.035071] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.035223] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.035551] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.035551] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.035747] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.035800] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.035851] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.035926] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d141340f-d099-4b67-88b0-348423856ab2 is going to be updated. [ 1058.037933] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.038128] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.038222] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.038404] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.038536] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.038692] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0322b3d5-d5cb-4d42-b1b7-1c62b05b7666" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.112932] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.113162] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.113162] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.113393] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.113555] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.126919] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d141340f-d099-4b67-88b0-348423856ab2 in Status: IN_PROGRESS for 2s [ 1058.226702] env[70614]: INFO networking_nsxv3.common.synchronization [req-e4b8013c-7e60-4d18-991e-d259ec799204 req-97fe941b-84ca-4dee-85bc-2ae6e46b9c39 tempest-ServerActionsTestOtherA-302418031 tempest-ServerActionsTestOtherA-302418031-project-member] Enqueued Resource ID: 28809bb1-c80b-4696-9980-5f00f47130bb with Priority: HIGHEST for action security_group_members [ 1058.227284] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28809bb1-c80b-4696-9980-5f00f47130bb with Priority: HIGHEST for action security_group_members [ 1058.227596] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-28809bb1-c80b-4696-9980-5f00f47130bb taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.227749] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28809bb1-c80b-4696-9980-5f00f47130bb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.227818] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28809bb1-c80b-4696-9980-5f00f47130bb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.228656] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28809bb1-c80b-4696-9980-5f00f47130bb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.228852] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.228963] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.229038] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.229214] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.229302] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.229403] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28809bb1-c80b-4696-9980-5f00f47130bb',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.394594] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f in Status: SUCCESS [ 1058.394794] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f deletion is rescheduled due to dependency. [ 1058.394845] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.394988] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.395263] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.395450] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.395587] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.395741] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.395815] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.395976] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.396081] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df8f20f5-6e92-4ac4-bdd2-05863ac4905f',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.520994] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-367 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.521232] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-367" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.521449] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-367" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.521756] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-367" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.522060] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.522368] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.522594] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.522844] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.523013] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.523233] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1058.523356] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1058.523456] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1058.523553] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1058.523729] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1058.523850] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1058.523934] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1058.543750] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1058.544120] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1058.544411] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1058.544707] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-367" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.545760] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-c1c83ee4-6325-44d4-b07e-24788049142b taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.545760] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-c1c83ee4-6325-44d4-b07e-24788049142b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.545760] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-c1c83ee4-6325-44d4-b07e-24788049142b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.546523] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-c1c83ee4-6325-44d4-b07e-24788049142b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.546523] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1c83ee4-6325-44d4-b07e-24788049142b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.732031] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.732031] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.732031] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.732263] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.732263] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.732485] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.732578] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.732623] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.732745] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.732819] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.732934] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28809bb1-c80b-4696-9980-5f00f47130bb already deleted. [ 1058.733072] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28809bb1-c80b-4696-9980-5f00f47130bb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.899871] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('df8f20f5-6e92-4ac4-bdd2-05863ac4905f',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.049246] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.049246] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.049246] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.049494] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.049633] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.049797] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port c1c83ee4-6325-44d4-b07e-24788049142b not found, creating... [ 1059.050075] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.050235] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.050357] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.050591] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.050771] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.051073] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.051229] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.051348] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.051554] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.051693] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.051836] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: c1c83ee4-6325-44d4-b07e-24788049142b is going to be created. [ 1059.072191] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.072448] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.072626] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.072967] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.073275] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.073551] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-c1c83ee4-6325-44d4-b07e-24788049142b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.402322] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('df8f20f5-6e92-4ac4-bdd2-05863ac4905f',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.888673] env[70614]: INFO networking_nsxv3.common.synchronization [req-e4b8013c-7e60-4d18-991e-d259ec799204 req-9ffa02ee-a852-4a24-bfa0-a4703e19dc4b service nova] Enqueued Resource ID: 28809bb1-c80b-4696-9980-5f00f47130bb with Priority: HIGHEST for action security_group_rules [ 1059.888869] env[70614]: INFO networking_nsxv3.common.synchronization [req-e4b8013c-7e60-4d18-991e-d259ec799204 req-9ffa02ee-a852-4a24-bfa0-a4703e19dc4b service nova] Enqueued Resource ID: 28809bb1-c80b-4696-9980-5f00f47130bb with Priority: HIGHEST for action security_group_members [ 1059.889048] env[70614]: INFO networking_nsxv3.common.synchronization [req-e4b8013c-7e60-4d18-991e-d259ec799204 req-9ffa02ee-a852-4a24-bfa0-a4703e19dc4b service nova] Enqueued Resource ID: c1c83ee4-6325-44d4-b07e-24788049142b with Priority: HIGHEST for action port [ 1059.889298] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28809bb1-c80b-4696-9980-5f00f47130bb with Priority: HIGHEST for action security_group_rules [ 1059.889427] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28809bb1-c80b-4696-9980-5f00f47130bb with Priority: HIGHEST for action security_group_members [ 1059.889522] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1c83ee4-6325-44d4-b07e-24788049142b with Priority: HIGHEST for action port [ 1059.890194] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-28809bb1-c80b-4696-9980-5f00f47130bb taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.890287] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-28809bb1-c80b-4696-9980-5f00f47130bb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.890355] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-28809bb1-c80b-4696-9980-5f00f47130bb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.890566] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-28809bb1-c80b-4696-9980-5f00f47130bb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.890668] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('28809bb1-c80b-4696-9980-5f00f47130bb',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.891543] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-28809bb1-c80b-4696-9980-5f00f47130bb taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.891658] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28809bb1-c80b-4696-9980-5f00f47130bb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.891727] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28809bb1-c80b-4696-9980-5f00f47130bb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.891945] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28809bb1-c80b-4696-9980-5f00f47130bb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.892145] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.892247] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.892309] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.892464] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.892568] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.892660] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28809bb1-c80b-4696-9980-5f00f47130bb',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.893498] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-c1c83ee4-6325-44d4-b07e-24788049142b taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.893572] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c1c83ee4-6325-44d4-b07e-24788049142b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.893617] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c1c83ee4-6325-44d4-b07e-24788049142b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.893771] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c1c83ee4-6325-44d4-b07e-24788049142b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.893865] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1c83ee4-6325-44d4-b07e-24788049142b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.904182] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.904529] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.904529] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.904529] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.904647] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.904684] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f is going to be updated. [ 1059.938624] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.938837] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.938837] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.939052] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.939205] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.948720] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f in Status: IN_PROGRESS for 2s [ 1059.990864] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45904912-7759-4b89-83ba-2a95c86ca5fd in Status: SUCCESS [ 1059.991578] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45904912-7759-4b89-83ba-2a95c86ca5fd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.139914] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d141340f-d099-4b67-88b0-348423856ab2 in Status: IN_PROGRESS for 4s [ 1060.395745] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('28809bb1-c80b-4696-9980-5f00f47130bb',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.397608] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-28809bb1-c80b-4696-9980-5f00f47130bb taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.397608] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28809bb1-c80b-4696-9980-5f00f47130bb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.397822] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c1c83ee4-6325-44d4-b07e-24788049142b with status ACTIVE [ 1060.397925] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.398046] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.398113] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.398323] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.398418] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.398568] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.398663] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.398723] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.398869] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.398943] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.399224] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.399325] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.399380] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.399525] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.399627] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.399698] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c1c83ee4-6325-44d4-b07e-24788049142b is going to be updated. [ 1060.434059] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.434059] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.434059] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.434392] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.434392] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.434639] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c1c83ee4-6325-44d4-b07e-24788049142b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.902698] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('28809bb1-c80b-4696-9980-5f00f47130bb',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.180032] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-20 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.180032] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-20" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.180032] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-20" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.180032] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-20" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.180032] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.180032] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.180884] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.181292] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.181590] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.182111] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1061.182375] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1061.182615] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1061.182856] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1061.185026] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1061.185026] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1061.185026] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1061.213581] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1061.214118] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1061.214468] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1061.214791] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-20" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.215321] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-e52d6b2b-cbee-42fc-bf72-9bdec59dae74 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.216124] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-e52d6b2b-cbee-42fc-bf72-9bdec59dae74" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.216124] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-e52d6b2b-cbee-42fc-bf72-9bdec59dae74" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.216381] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-e52d6b2b-cbee-42fc-bf72-9bdec59dae74" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.216655] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e52d6b2b-cbee-42fc-bf72-9bdec59dae74',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.404674] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.404863] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.404932] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.405342] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.405455] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.405559] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28809bb1-c80b-4696-9980-5f00f47130bb is going to be created. [ 1061.436425] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.436617] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.436700] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.438122] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.438122] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.452175] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28809bb1-c80b-4696-9980-5f00f47130bb in Status: UNINITIALIZED for 2s [ 1061.561089] env[70614]: INFO networking_nsxv3.common.synchronization [req-8ee0402f-15ab-4033-aa14-ad487fa652c2 req-c6262abc-fa58-4550-a7d3-a5268cf65a3e tempest-ServersTestFqdnHostnames-100799831 tempest-ServersTestFqdnHostnames-100799831-project-member] Enqueued Resource ID: dd5a38a7-babd-4c6b-b3a5-af13dd79865d with Priority: HIGHEST for action security_group_members [ 1061.561792] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd5a38a7-babd-4c6b-b3a5-af13dd79865d with Priority: HIGHEST for action security_group_members [ 1061.562551] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd5a38a7-babd-4c6b-b3a5-af13dd79865d taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.562709] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd5a38a7-babd-4c6b-b3a5-af13dd79865d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.562755] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd5a38a7-babd-4c6b-b3a5-af13dd79865d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.562963] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd5a38a7-babd-4c6b-b3a5-af13dd79865d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.563146] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.563253] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.563316] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.563480] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.563565] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.564336] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd5a38a7-babd-4c6b-b3a5-af13dd79865d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.719505] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.719505] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.722024] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.722024] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.722024] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.722024] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.722024] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.722024] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.724943] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.725183] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.725725] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.726060] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.726275] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.726645] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.726916] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.727149] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: e52d6b2b-cbee-42fc-bf72-9bdec59dae74 is going to be updated. [ 1061.758433] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.758696] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.758890] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.759174] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.759535] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.759940] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-e52d6b2b-cbee-42fc-bf72-9bdec59dae74" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.970561] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f in Status: SUCCESS [ 1061.970561] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.970779] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.970893] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.971109] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.971232] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.971297] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.971452] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.971530] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.971612] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.971700] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('df8f20f5-6e92-4ac4-bdd2-05863ac4905f',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.066448] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.066613] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.066679] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.066961] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.066961] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.067988] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.067988] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.067988] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.067988] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.067988] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.067988] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd5a38a7-babd-4c6b-b3a5-af13dd79865d is going to be updated. [ 1062.109981] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.111304] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.111663] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.111663] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.111835] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.127021] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd5a38a7-babd-4c6b-b3a5-af13dd79865d in Status: IN_PROGRESS for 2s [ 1062.150779] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d141340f-d099-4b67-88b0-348423856ab2 in Status: SUCCESS [ 1062.150962] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d141340f-d099-4b67-88b0-348423856ab2 deletion is rescheduled due to dependency. [ 1062.151076] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.151249] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.151476] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.151678] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.151872] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.151872] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.152143] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.152231] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.152322] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.152492] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-d141340f-d099-4b67-88b0-348423856ab2 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.152595] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.152655] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.152800] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.152938] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.153229] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.153337] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.153458] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.153537] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.153624] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.153719] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d141340f-d099-4b67-88b0-348423856ab2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.474921] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.475431] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.475431] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.475586] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.475760] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.475900] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.475969] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.476096] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.476323] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.476323] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.476456] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.476533] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.476586] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.476712] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.476840] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.476931] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.476994] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.477138] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.477215] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.477297] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.477387] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('df8f20f5-6e92-4ac4-bdd2-05863ac4905f',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.587023] env[70614]: INFO networking_nsxv3.common.synchronization [req-1fec8c8b-0e7a-456a-ac23-d90ea2160d37 req-c2512c7a-a845-4c32-a484-224272dd6a5a service nova] Enqueued Resource ID: 4be97761-0b55-45fd-ba63-8ef18d95b9f2 with Priority: HIGHEST for action security_group_rules [ 1062.587280] env[70614]: INFO networking_nsxv3.common.synchronization [req-1fec8c8b-0e7a-456a-ac23-d90ea2160d37 req-c2512c7a-a845-4c32-a484-224272dd6a5a service nova] Enqueued Resource ID: 4be97761-0b55-45fd-ba63-8ef18d95b9f2 with Priority: HIGHEST for action security_group_members [ 1062.587463] env[70614]: INFO networking_nsxv3.common.synchronization [req-1fec8c8b-0e7a-456a-ac23-d90ea2160d37 req-c2512c7a-a845-4c32-a484-224272dd6a5a service nova] Enqueued Resource ID: e52d6b2b-cbee-42fc-bf72-9bdec59dae74 with Priority: HIGHEST for action port [ 1062.588189] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4be97761-0b55-45fd-ba63-8ef18d95b9f2 with Priority: HIGHEST for action security_group_rules [ 1062.588390] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4be97761-0b55-45fd-ba63-8ef18d95b9f2 with Priority: HIGHEST for action security_group_members [ 1062.588506] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e52d6b2b-cbee-42fc-bf72-9bdec59dae74 with Priority: HIGHEST for action port [ 1062.588861] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4be97761-0b55-45fd-ba63-8ef18d95b9f2 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.589027] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.589137] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.589412] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.589511] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4be97761-0b55-45fd-ba63-8ef18d95b9f2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.590639] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-4be97761-0b55-45fd-ba63-8ef18d95b9f2 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.590789] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.590874] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.591049] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.591253] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.591413] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.591491] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.591640] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.591755] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.591896] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4be97761-0b55-45fd-ba63-8ef18d95b9f2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.592858] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-e52d6b2b-cbee-42fc-bf72-9bdec59dae74 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.592984] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e52d6b2b-cbee-42fc-bf72-9bdec59dae74" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.592984] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e52d6b2b-cbee-42fc-bf72-9bdec59dae74" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.593220] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e52d6b2b-cbee-42fc-bf72-9bdec59dae74" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.593285] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e52d6b2b-cbee-42fc-bf72-9bdec59dae74',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.656422] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d141340f-d099-4b67-88b0-348423856ab2: rpc.has_security_group_logging(os_id): False [ 1062.680014] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.680014] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.680014] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.680014] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.680014] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.680014] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.680014] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.680014] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.680014] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.680014] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.680014] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.680014] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.680014] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.681210] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.681481] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.681871] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.683022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.683022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.683310] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.684184] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.684184] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d141340f-d099-4b67-88b0-348423856ab2 is going to be updated. [ 1062.760159] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.760324] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.760396] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.760623] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.760806] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.777440] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d141340f-d099-4b67-88b0-348423856ab2 in Status: IN_PROGRESS for 2s [ 1062.980296] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for df8f20f5-6e92-4ac4-bdd2-05863ac4905f: rpc.has_security_group_logging(os_id): False [ 1062.999665] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.999905] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.999956] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.000175] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.000269] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.000532] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.000630] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.000741] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.000877] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.000973] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.001186] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.001275] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.001339] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.001490] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.001588] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.001780] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.001915] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.001979] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.002082] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.002156] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.002241] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f is going to be updated. [ 1063.068498] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.068760] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.068760] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.069029] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.069222] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.087336] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f in Status: IN_PROGRESS for 2s [ 1063.094803] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4be97761-0b55-45fd-ba63-8ef18d95b9f2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.095942] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-4be97761-0b55-45fd-ba63-8ef18d95b9f2 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.096137] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.100704] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e52d6b2b-cbee-42fc-bf72-9bdec59dae74 with status ACTIVE [ 1063.100839] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.100967] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.101067] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.101362] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.101484] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.101717] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.101858] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.101956] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.102191] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.102316] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.102586] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.102731] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.102908] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.103141] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.103264] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.103400] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e52d6b2b-cbee-42fc-bf72-9bdec59dae74 is going to be updated. [ 1063.141207] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.141476] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.141476] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.141622] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.141807] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.141929] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e52d6b2b-cbee-42fc-bf72-9bdec59dae74" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.472023] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28809bb1-c80b-4696-9980-5f00f47130bb in Status: SUCCESS [ 1063.472023] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28809bb1-c80b-4696-9980-5f00f47130bb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.472023] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28809bb1-c80b-4696-9980-5f00f47130bb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.472023] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28809bb1-c80b-4696-9980-5f00f47130bb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.472023] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.472023] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.472023] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.472023] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.472023] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.472542] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28809bb1-c80b-4696-9980-5f00f47130bb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.472542] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('28809bb1-c80b-4696-9980-5f00f47130bb',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.598088] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4be97761-0b55-45fd-ba63-8ef18d95b9f2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.975878] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('28809bb1-c80b-4696-9980-5f00f47130bb',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.099773] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.100093] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.100093] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.100263] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.100352] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.100454] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4be97761-0b55-45fd-ba63-8ef18d95b9f2 is going to be updated. [ 1064.129823] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.130124] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.130124] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.130305] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.130453] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.140058] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd5a38a7-babd-4c6b-b3a5-af13dd79865d in Status: SUCCESS [ 1064.140385] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd5a38a7-babd-4c6b-b3a5-af13dd79865d deletion is rescheduled due to dependency. [ 1064.140528] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd5a38a7-babd-4c6b-b3a5-af13dd79865d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.141618] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4be97761-0b55-45fd-ba63-8ef18d95b9f2 in Status: IN_PROGRESS for 2s [ 1064.480943] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 28809bb1-c80b-4696-9980-5f00f47130bb: rpc.has_security_group_logging(os_id): False [ 1064.500701] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.501013] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.501013] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.501221] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.501336] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.501597] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.501698] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.501761] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.501971] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.502179] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.502179] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 28809bb1-c80b-4696-9980-5f00f47130bb is going to be created. [ 1064.575351] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.575553] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.575638] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.575792] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.576080] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.592706] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 28809bb1-c80b-4696-9980-5f00f47130bb in Status: IN_PROGRESS for 2s [ 1064.799947] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d141340f-d099-4b67-88b0-348423856ab2 in Status: SUCCESS [ 1064.800263] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.106574] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f in Status: SUCCESS [ 1065.106807] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.155826] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4be97761-0b55-45fd-ba63-8ef18d95b9f2 in Status: SUCCESS [ 1066.155826] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.155826] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.155826] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.155826] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.155826] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.155826] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.155826] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.155826] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.155826] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.156596] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4be97761-0b55-45fd-ba63-8ef18d95b9f2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.608837] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 28809bb1-c80b-4696-9980-5f00f47130bb in Status: SUCCESS [ 1066.609120] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-28809bb1-c80b-4696-9980-5f00f47130bb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.660025] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-4be97761-0b55-45fd-ba63-8ef18d95b9f2 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.660025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.660025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.660025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.660025] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.660025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.660025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.660025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.660025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.660557] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.660557] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-4be97761-0b55-45fd-ba63-8ef18d95b9f2 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.660557] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.660557] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.662140] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.662523] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.662814] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.662889] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.663064] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.663152] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.663242] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.663895] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4be97761-0b55-45fd-ba63-8ef18d95b9f2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.169313] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4be97761-0b55-45fd-ba63-8ef18d95b9f2: rpc.has_security_group_logging(os_id): False [ 1067.187444] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.187599] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.187847] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.188246] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.188408] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.188778] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.188947] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.189069] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.189332] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.189465] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.189856] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.190080] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.190201] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.190433] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.190629] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.190870] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.191071] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.191183] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.191409] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.191528] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.191664] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4be97761-0b55-45fd-ba63-8ef18d95b9f2 is going to be updated. [ 1067.243726] env[70614]: INFO networking_nsxv3.common.synchronization [req-1c89a782-80b9-4616-9477-661e3f58e5ac req-d82f7f85-a08d-4e62-a4cd-ad53e692a184 tempest-ImagesTestJSON-1765947257 tempest-ImagesTestJSON-1765947257-project-member] Enqueued Resource ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 with Priority: HIGHEST for action security_group_members [ 1067.243726] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 with Priority: HIGHEST for action security_group_members [ 1067.243726] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-04a082fe-52f7-4ac6-a12b-63791c63be86 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.243726] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.243726] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.243726] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.243726] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.244243] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.244243] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.244243] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.244243] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.244243] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04a082fe-52f7-4ac6-a12b-63791c63be86',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.275371] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.276399] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.276399] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.276399] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.276399] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.290869] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4be97761-0b55-45fd-ba63-8ef18d95b9f2 in Status: IN_PROGRESS for 2s [ 1067.747416] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.747697] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.747833] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.748160] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.748317] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.748639] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.748802] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.748917] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.749202] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.749471] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.749471] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 is going to be updated. [ 1067.785726] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.785877] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.785943] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.786205] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.786977] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.797370] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 in Status: IN_PROGRESS for 2s [ 1069.303738] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4be97761-0b55-45fd-ba63-8ef18d95b9f2 in Status: SUCCESS [ 1069.304201] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.781375] env[70614]: INFO networking_nsxv3.common.synchronization [None req-21e31502-c0f3-454c-93d3-9426da1b78a7 None None] Enqueued Resource ID: 3a1f43c6-9698-44a1-a40a-a63e88d498e2 with Priority: HIGHEST for action port [ 1069.781977] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a1f43c6-9698-44a1-a40a-a63e88d498e2 with Priority: HIGHEST for action port [ 1069.783214] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-3a1f43c6-9698-44a1-a40a-a63e88d498e2 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.783318] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3a1f43c6-9698-44a1-a40a-a63e88d498e2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.783391] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3a1f43c6-9698-44a1-a40a-a63e88d498e2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.783668] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3a1f43c6-9698-44a1-a40a-a63e88d498e2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.783756] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a1f43c6-9698-44a1-a40a-a63e88d498e2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.812826] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 in Status: SUCCESS [ 1069.813196] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 deletion is rescheduled due to dependency. [ 1069.813353] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.059024] env[70614]: INFO networking_nsxv3.common.synchronization [req-0f683d20-98b2-4386-a942-d27f07d62371 req-db8c2d40-24b9-4b4c-a081-a77c3e66960d tempest-ServerActionsV293TestJSON-1550365301 tempest-ServerActionsV293TestJSON-1550365301-project-member] Enqueued Resource ID: ced2222f-152a-4951-8da3-65259a9e32af with Priority: HIGHEST for action security_group_members [ 1070.059024] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ced2222f-152a-4951-8da3-65259a9e32af with Priority: HIGHEST for action security_group_members [ 1070.059024] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-ced2222f-152a-4951-8da3-65259a9e32af taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.059024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ced2222f-152a-4951-8da3-65259a9e32af" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.059024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ced2222f-152a-4951-8da3-65259a9e32af" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.059024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ced2222f-152a-4951-8da3-65259a9e32af" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.059024] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.059024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.059024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.059024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.059554] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.059554] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ced2222f-152a-4951-8da3-65259a9e32af',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.071151] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-385 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.071435] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-385" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.071578] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-385" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.071874] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-385" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.072633] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.072905] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.073094] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.073396] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.073795] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.073885] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1070.074163] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1070.074278] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1070.074430] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1070.074617] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1070.075406] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1070.075646] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1070.102559] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1070.102770] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1070.102849] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1070.103059] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-385" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.103423] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-0ae70826-e27e-468b-a7e9-cefff160de53 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.103617] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-0ae70826-e27e-468b-a7e9-cefff160de53" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.103757] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-0ae70826-e27e-468b-a7e9-cefff160de53" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.104136] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-0ae70826-e27e-468b-a7e9-cefff160de53" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.104276] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ae70826-e27e-468b-a7e9-cefff160de53',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.266270] env[70614]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1070.266451] env[70614]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] NSXv3 Agent Agent loop - iteration:2 started [ 1070.292144] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3a1f43c6-9698-44a1-a40a-a63e88d498e2 [ 1070.292294] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.292387] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.292434] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.292744] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.292744] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.292881] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3a1f43c6-9698-44a1-a40a-a63e88d498e2 already deleted. [ 1070.292921] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3a1f43c6-9698-44a1-a40a-a63e88d498e2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.563297] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.563590] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.563633] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.564224] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.564224] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.564500] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.564500] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.564641] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.564846] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.564846] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.564846] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ced2222f-152a-4951-8da3-65259a9e32af already deleted. [ 1070.564988] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ced2222f-152a-4951-8da3-65259a9e32af" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.608463] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.608463] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.608463] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.610817] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.610817] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.610817] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 0ae70826-e27e-468b-a7e9-cefff160de53 not found, creating... [ 1070.610817] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.610817] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.611272] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.611630] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.611692] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.612024] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.612206] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.612349] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.612579] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.612732] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.612887] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 0ae70826-e27e-468b-a7e9-cefff160de53 is going to be created. [ 1070.641445] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.641692] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.644360] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.644681] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.645013] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.645333] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-0ae70826-e27e-468b-a7e9-cefff160de53" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.696821] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-314 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.696938] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-314" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.697085] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-314" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.697456] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-314" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.697892] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.698401] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.698588] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.698882] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.702065] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.702065] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1070.702065] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1070.702065] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1070.702065] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1070.702065] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1070.702065] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1070.702065] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1070.740385] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1070.742758] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.039 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1070.742758] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1070.742758] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-314" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.742758] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-a7d0f757-31e4-4ec7-afbe-3358e91fbe7f taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.743181] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-a7d0f757-31e4-4ec7-afbe-3358e91fbe7f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.743181] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-a7d0f757-31e4-4ec7-afbe-3358e91fbe7f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.744352] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-a7d0f757-31e4-4ec7-afbe-3358e91fbe7f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.744352] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7d0f757-31e4-4ec7-afbe-3358e91fbe7f',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.250029] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.250029] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.250029] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.250029] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.250029] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.250029] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port a7d0f757-31e4-4ec7-afbe-3358e91fbe7f not found, creating... [ 1071.250029] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.250029] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.250029] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.250029] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.250029] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.252087] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.252535] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.252821] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.253223] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.255592] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.255592] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: a7d0f757-31e4-4ec7-afbe-3358e91fbe7f is going to be created. [ 1071.327536] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.327536] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.327536] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.327536] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.327536] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.327536] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-a7d0f757-31e4-4ec7-afbe-3358e91fbe7f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.721843] env[70614]: INFO networking_nsxv3.common.synchronization [req-221ab976-acff-4f1a-9790-a0523129a1cd req-ed2fb399-083e-473d-8fab-4a1c16d23737 service nova] Enqueued Resource ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 with Priority: HIGHEST for action security_group_rules [ 1071.726120] env[70614]: INFO networking_nsxv3.common.synchronization [req-221ab976-acff-4f1a-9790-a0523129a1cd req-ed2fb399-083e-473d-8fab-4a1c16d23737 service nova] Enqueued Resource ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 with Priority: HIGHEST for action security_group_members [ 1071.726120] env[70614]: INFO networking_nsxv3.common.synchronization [req-221ab976-acff-4f1a-9790-a0523129a1cd req-ed2fb399-083e-473d-8fab-4a1c16d23737 service nova] Enqueued Resource ID: 0ae70826-e27e-468b-a7e9-cefff160de53 with Priority: HIGHEST for action port [ 1071.730035] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 with Priority: HIGHEST for action security_group_rules [ 1071.730035] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 with Priority: HIGHEST for action security_group_members [ 1071.730035] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ae70826-e27e-468b-a7e9-cefff160de53 with Priority: HIGHEST for action port [ 1071.730035] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d3a5ad0-c473-4d61-9101-9c7582c27390 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.730035] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.730035] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.730035] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.730035] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d3a5ad0-c473-4d61-9101-9c7582c27390',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.730035] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d3a5ad0-c473-4d61-9101-9c7582c27390 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.730035] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.730035] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.730035] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.730035] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.730035] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.730035] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.730035] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.730035] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.730035] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d3a5ad0-c473-4d61-9101-9c7582c27390',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.732341] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-0ae70826-e27e-468b-a7e9-cefff160de53 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.734349] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0ae70826-e27e-468b-a7e9-cefff160de53" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.734349] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0ae70826-e27e-468b-a7e9-cefff160de53" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.734349] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0ae70826-e27e-468b-a7e9-cefff160de53" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.734349] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ae70826-e27e-468b-a7e9-cefff160de53',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.066195] env[70614]: INFO networking_nsxv3.common.synchronization [req-0f683d20-98b2-4386-a942-d27f07d62371 req-e49324ea-c9f0-44a9-9493-10aa87333ad1 service nova] Enqueued Resource ID: ced2222f-152a-4951-8da3-65259a9e32af with Priority: HIGHEST for action security_group_rules [ 1072.066195] env[70614]: INFO networking_nsxv3.common.synchronization [req-0f683d20-98b2-4386-a942-d27f07d62371 req-e49324ea-c9f0-44a9-9493-10aa87333ad1 service nova] Enqueued Resource ID: ced2222f-152a-4951-8da3-65259a9e32af with Priority: HIGHEST for action security_group_members [ 1072.066195] env[70614]: INFO networking_nsxv3.common.synchronization [req-0f683d20-98b2-4386-a942-d27f07d62371 req-e49324ea-c9f0-44a9-9493-10aa87333ad1 service nova] Enqueued Resource ID: a7d0f757-31e4-4ec7-afbe-3358e91fbe7f with Priority: HIGHEST for action port [ 1072.066195] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ced2222f-152a-4951-8da3-65259a9e32af with Priority: HIGHEST for action security_group_rules [ 1072.066195] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ced2222f-152a-4951-8da3-65259a9e32af with Priority: HIGHEST for action security_group_members [ 1072.066195] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7d0f757-31e4-4ec7-afbe-3358e91fbe7f with Priority: HIGHEST for action port [ 1072.070228] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ced2222f-152a-4951-8da3-65259a9e32af taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.070419] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ced2222f-152a-4951-8da3-65259a9e32af" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.070508] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ced2222f-152a-4951-8da3-65259a9e32af" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.070766] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ced2222f-152a-4951-8da3-65259a9e32af" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.070856] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ced2222f-152a-4951-8da3-65259a9e32af',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.072255] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-ced2222f-152a-4951-8da3-65259a9e32af taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.072393] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ced2222f-152a-4951-8da3-65259a9e32af" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.072484] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ced2222f-152a-4951-8da3-65259a9e32af" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.072686] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ced2222f-152a-4951-8da3-65259a9e32af" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.072864] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.073038] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.074187] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.074378] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.077334] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.077334] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ced2222f-152a-4951-8da3-65259a9e32af',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.077334] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-a7d0f757-31e4-4ec7-afbe-3358e91fbe7f taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.077834] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a7d0f757-31e4-4ec7-afbe-3358e91fbe7f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.077834] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a7d0f757-31e4-4ec7-afbe-3358e91fbe7f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.077834] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a7d0f757-31e4-4ec7-afbe-3358e91fbe7f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.077834] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7d0f757-31e4-4ec7-afbe-3358e91fbe7f',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.238022] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d3a5ad0-c473-4d61-9101-9c7582c27390 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.238022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.238022] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0ae70826-e27e-468b-a7e9-cefff160de53 with status ACTIVE [ 1072.238022] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.238022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.238022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.238022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.238022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.238022] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.238022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.238022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.238022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.238022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.238022] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.239486] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.239486] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.239486] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.239486] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.239486] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0ae70826-e27e-468b-a7e9-cefff160de53 is going to be updated. [ 1072.241084] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d3a5ad0-c473-4d61-9101-9c7582c27390',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.266341] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.266341] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.266341] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.266341] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.266341] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.266341] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0ae70826-e27e-468b-a7e9-cefff160de53" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.305269] env[70614]: INFO networking_nsxv3.common.synchronization [None req-24eba495-f5f3-4a6b-9362-d9fea3cfc817 None None] Enqueued Resource ID: fe79d480-3126-48ec-97a7-1dc8c4455678 with Priority: HIGHEST for action port [ 1072.305269] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe79d480-3126-48ec-97a7-1dc8c4455678 with Priority: HIGHEST for action port [ 1072.305269] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe79d480-3126-48ec-97a7-1dc8c4455678 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.305269] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe79d480-3126-48ec-97a7-1dc8c4455678" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.305269] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe79d480-3126-48ec-97a7-1dc8c4455678" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.305269] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe79d480-3126-48ec-97a7-1dc8c4455678" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.305844] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe79d480-3126-48ec-97a7-1dc8c4455678',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.577583] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ced2222f-152a-4951-8da3-65259a9e32af',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.582022] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-ced2222f-152a-4951-8da3-65259a9e32af taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.582022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ced2222f-152a-4951-8da3-65259a9e32af" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.582022] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a7d0f757-31e4-4ec7-afbe-3358e91fbe7f with status ACTIVE [ 1072.582022] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.582022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.582022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.582022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.582022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.582022] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.582022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.582022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.582022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.582022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.582022] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.582937] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.582937] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.582937] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.582937] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.582937] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a7d0f757-31e4-4ec7-afbe-3358e91fbe7f is going to be updated. [ 1072.616475] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.616475] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.616475] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.616737] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.616811] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.616922] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a7d0f757-31e4-4ec7-afbe-3358e91fbe7f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.743670] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d3a5ad0-c473-4d61-9101-9c7582c27390',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.809039] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fe79d480-3126-48ec-97a7-1dc8c4455678 [ 1072.809039] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.809039] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.809039] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.809371] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.809371] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.809443] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fe79d480-3126-48ec-97a7-1dc8c4455678 already deleted. [ 1072.809477] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe79d480-3126-48ec-97a7-1dc8c4455678" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.080224] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ced2222f-152a-4951-8da3-65259a9e32af',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.247077] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.247346] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.247526] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.247800] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.247951] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.248074] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 is going to be updated. [ 1073.300029] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.300029] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.300218] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.300312] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.300474] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.312751] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 in Status: IN_PROGRESS for 2s [ 1073.585390] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.585390] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.585390] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.585390] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.585390] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.585390] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ced2222f-152a-4951-8da3-65259a9e32af is going to be created. [ 1073.618224] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.618224] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.618224] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.618224] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.618224] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.632054] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ced2222f-152a-4951-8da3-65259a9e32af in Status: UNINITIALIZED for 2s [ 1075.327381] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 in Status: SUCCESS [ 1075.327911] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.327911] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.328139] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.328240] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.328363] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.328420] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.328600] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.328682] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.328770] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.328863] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6d3a5ad0-c473-4d61-9101-9c7582c27390',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.648809] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ced2222f-152a-4951-8da3-65259a9e32af in Status: SUCCESS [ 1075.648809] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ced2222f-152a-4951-8da3-65259a9e32af" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.648809] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ced2222f-152a-4951-8da3-65259a9e32af" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.648809] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ced2222f-152a-4951-8da3-65259a9e32af" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.648809] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.648809] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.648809] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.648809] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.648809] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.648809] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ced2222f-152a-4951-8da3-65259a9e32af" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.648809] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ced2222f-152a-4951-8da3-65259a9e32af',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.831654] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d3a5ad0-c473-4d61-9101-9c7582c27390 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.831825] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.831897] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.832186] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.832364] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.832667] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.832667] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.832766] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.832766] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.832882] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.833014] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d3a5ad0-c473-4d61-9101-9c7582c27390 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.833114] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.833176] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.833335] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.833515] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.833944] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.833944] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.833944] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.833944] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.833944] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.834235] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6d3a5ad0-c473-4d61-9101-9c7582c27390',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.150784] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ced2222f-152a-4951-8da3-65259a9e32af',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.337038] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6d3a5ad0-c473-4d61-9101-9c7582c27390: rpc.has_security_group_logging(os_id): False [ 1076.357040] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.357182] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.357254] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.357488] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.357620] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.357796] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.358070] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.358158] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.358304] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.359086] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.359332] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.359963] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.359963] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.359963] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.360240] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.360454] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.360546] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.360647] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.360783] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.360857] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.360929] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 is going to be updated. [ 1076.433821] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.433821] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.433821] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.433821] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.433821] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.446305] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 in Status: IN_PROGRESS for 2s [ 1076.654781] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ced2222f-152a-4951-8da3-65259a9e32af: rpc.has_security_group_logging(os_id): False [ 1076.672382] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.674390] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.674390] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.674390] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.674390] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.674390] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.674390] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.674390] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.674390] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.674390] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.675029] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ced2222f-152a-4951-8da3-65259a9e32af is going to be created. [ 1076.767660] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.767660] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.767902] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.768344] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.768559] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.788095] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ced2222f-152a-4951-8da3-65259a9e32af in Status: IN_PROGRESS for 2s [ 1077.305649] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1077.305649] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1078.469059] env[70614]: INFO networking_nsxv3.common.synchronization [req-6ed50e6a-80b8-4f17-85d8-7f8b6344b300 req-0990a7b7-54c8-4835-af39-8e7bb97aa2b9 tempest-ServerRescueNegativeTestJSON-1616269448 tempest-ServerRescueNegativeTestJSON-1616269448-project-member] Enqueued Resource ID: 9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1 with Priority: HIGHEST for action security_group_members [ 1078.470311] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 in Status: SUCCESS [ 1078.470525] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.471963] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1 with Priority: HIGHEST for action security_group_members [ 1078.471963] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.471963] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.471963] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.471963] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.472211] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.472211] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.472309] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.472429] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.473979] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.473979] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.800941] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ced2222f-152a-4951-8da3-65259a9e32af in Status: SUCCESS [ 1078.801282] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ced2222f-152a-4951-8da3-65259a9e32af" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.873756] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-225 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.874029] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-225" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.874158] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-225" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.874494] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-225" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.875136] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.875136] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.875136] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.875334] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.875710] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.875710] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1078.875874] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1078.875974] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1078.876091] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1078.876727] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1078.876727] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1078.876727] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1078.897243] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1078.897411] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1078.897554] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1078.897754] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-225" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.898108] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-142c7a85-0820-4e32-b2fc-a23ee161cbd1 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.898290] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-142c7a85-0820-4e32-b2fc-a23ee161cbd1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.898417] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-142c7a85-0820-4e32-b2fc-a23ee161cbd1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.898756] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-142c7a85-0820-4e32-b2fc-a23ee161cbd1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.898904] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('142c7a85-0820-4e32-b2fc-a23ee161cbd1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.975784] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.975919] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.975919] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.976149] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.976258] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.976468] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.976597] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.976663] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.976837] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.976920] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.977014] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1 already deleted. [ 1078.977098] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.401072] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.401377] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.401473] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.401770] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.401946] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.402167] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 142c7a85-0820-4e32-b2fc-a23ee161cbd1 not found, creating... [ 1079.402447] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.402618] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.402744] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.402990] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.403146] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.403548] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.403738] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.403865] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.404669] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.404893] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.405076] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 142c7a85-0820-4e32-b2fc-a23ee161cbd1 is going to be created. [ 1079.429496] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.429777] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.429940] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.430267] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.430537] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.430840] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-142c7a85-0820-4e32-b2fc-a23ee161cbd1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.192043] env[70614]: INFO networking_nsxv3.common.synchronization [req-6ed50e6a-80b8-4f17-85d8-7f8b6344b300 req-04f3a101-18d9-40f9-acfe-3dd37a46b668 service nova] Enqueued Resource ID: 9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1 with Priority: HIGHEST for action security_group_rules [ 1080.192043] env[70614]: INFO networking_nsxv3.common.synchronization [req-6ed50e6a-80b8-4f17-85d8-7f8b6344b300 req-04f3a101-18d9-40f9-acfe-3dd37a46b668 service nova] Enqueued Resource ID: 9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1 with Priority: HIGHEST for action security_group_members [ 1080.192465] env[70614]: INFO networking_nsxv3.common.synchronization [req-6ed50e6a-80b8-4f17-85d8-7f8b6344b300 req-04f3a101-18d9-40f9-acfe-3dd37a46b668 service nova] Enqueued Resource ID: 142c7a85-0820-4e32-b2fc-a23ee161cbd1 with Priority: HIGHEST for action port [ 1080.192465] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1 with Priority: HIGHEST for action security_group_rules [ 1080.192524] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1 with Priority: HIGHEST for action security_group_members [ 1080.192583] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 142c7a85-0820-4e32-b2fc-a23ee161cbd1 with Priority: HIGHEST for action port [ 1080.193830] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.193830] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.193830] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.193830] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.193830] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.194835] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.195272] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.195272] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.195272] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.195434] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.195573] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.195660] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.196014] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.196014] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.196014] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.197213] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-142c7a85-0820-4e32-b2fc-a23ee161cbd1 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.197353] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-142c7a85-0820-4e32-b2fc-a23ee161cbd1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.197445] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-142c7a85-0820-4e32-b2fc-a23ee161cbd1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.197652] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-142c7a85-0820-4e32-b2fc-a23ee161cbd1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.197741] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('142c7a85-0820-4e32-b2fc-a23ee161cbd1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.631773] env[70614]: INFO networking_nsxv3.common.synchronization [None req-b0b6a3c2-5d33-4d50-aea2-01a176fced60 None None] Enqueued Resource ID: 0bfeddf4-3e76-471b-82b2-833ae4a4c85a with Priority: HIGHEST for action port [ 1080.632303] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bfeddf4-3e76-471b-82b2-833ae4a4c85a with Priority: HIGHEST for action port [ 1080.632614] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-0bfeddf4-3e76-471b-82b2-833ae4a4c85a taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.635277] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0bfeddf4-3e76-471b-82b2-833ae4a4c85a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.635277] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0bfeddf4-3e76-471b-82b2-833ae4a4c85a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.635277] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0bfeddf4-3e76-471b-82b2-833ae4a4c85a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.635277] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0bfeddf4-3e76-471b-82b2-833ae4a4c85a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.699294] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.700656] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.700789] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.701310] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 142c7a85-0820-4e32-b2fc-a23ee161cbd1 with status ACTIVE [ 1080.701474] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.702180] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.702180] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.702180] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.702180] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.703045] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.703045] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.703045] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.703045] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.703045] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.703045] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.703045] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.703045] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.703500] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.703500] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.703500] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 142c7a85-0820-4e32-b2fc-a23ee161cbd1 is going to be updated. [ 1080.713322] env[70614]: INFO networking_nsxv3.common.synchronization [req-4ec2910d-dd6d-4f3c-aabb-d5db3c1e2074 req-fb056177-56d9-4c22-a1f7-a346a48894fd tempest-ServerRescueNegativeTestJSON-1616269448 tempest-ServerRescueNegativeTestJSON-1616269448-project-member] Enqueued Resource ID: 9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1 with Priority: HIGHEST for action security_group_members [ 1080.714116] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1 with Priority: HIGHEST for action security_group_members [ 1080.714246] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.714404] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.730155] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.730319] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.730389] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.730608] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.730788] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.730990] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-142c7a85-0820-4e32-b2fc-a23ee161cbd1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.067761] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-225 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.067999] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-225" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.068139] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-225" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.068413] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-225" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.068682] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.068844] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.068967] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.073660] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.073836] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.074079] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1081.074201] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1081.074315] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1081.074425] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1081.075702] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1081.075702] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1081.075702] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1081.100498] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1081.100759] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1081.100907] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1081.101138] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-225" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.101502] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-687c41c8-941c-4f96-b109-c7a919182027 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.101709] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-687c41c8-941c-4f96-b109-c7a919182027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.101866] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-687c41c8-941c-4f96-b109-c7a919182027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.102256] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-687c41c8-941c-4f96-b109-c7a919182027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.102423] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('687c41c8-941c-4f96-b109-c7a919182027',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.139478] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0bfeddf4-3e76-471b-82b2-833ae4a4c85a [ 1081.139699] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.139825] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.139901] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.140144] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.140230] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.140327] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0bfeddf4-3e76-471b-82b2-833ae4a4c85a already deleted. [ 1081.140406] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0bfeddf4-3e76-471b-82b2-833ae4a4c85a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.205903] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.607780] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.608030] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.608167] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.608464] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.608706] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.608960] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 687c41c8-941c-4f96-b109-c7a919182027 not found, creating... [ 1081.609386] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.609646] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.609893] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.610268] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.610595] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.610993] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.611294] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.611544] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.611747] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.612103] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.612197] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 687c41c8-941c-4f96-b109-c7a919182027 is going to be created. [ 1081.636464] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.636787] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.636960] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.637339] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.637644] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.637918] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-687c41c8-941c-4f96-b109-c7a919182027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.708991] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.709215] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.709455] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.709524] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.709628] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.709762] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1 is going to be created. [ 1081.753963] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.755047] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.755047] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.755047] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.755047] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.768104] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1 in Status: UNINITIALIZED for 2s [ 1082.433152] env[70614]: INFO networking_nsxv3.common.synchronization [req-4ec2910d-dd6d-4f3c-aabb-d5db3c1e2074 req-7bd59e00-716d-41c5-89e8-82318e65d15f service nova] Enqueued Resource ID: 9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1 with Priority: HIGHEST for action security_group_rules [ 1082.433152] env[70614]: INFO networking_nsxv3.common.synchronization [req-4ec2910d-dd6d-4f3c-aabb-d5db3c1e2074 req-7bd59e00-716d-41c5-89e8-82318e65d15f service nova] Enqueued Resource ID: 9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1 with Priority: HIGHEST for action security_group_members [ 1082.433152] env[70614]: INFO networking_nsxv3.common.synchronization [req-4ec2910d-dd6d-4f3c-aabb-d5db3c1e2074 req-7bd59e00-716d-41c5-89e8-82318e65d15f service nova] Enqueued Resource ID: 687c41c8-941c-4f96-b109-c7a919182027 with Priority: HIGHEST for action port [ 1082.433152] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1 with Priority: HIGHEST for action security_group_rules [ 1082.433152] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1 with Priority: HIGHEST for action security_group_members [ 1082.433152] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 687c41c8-941c-4f96-b109-c7a919182027 with Priority: HIGHEST for action port [ 1082.435861] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.436364] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.436767] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.436974] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.437282] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-687c41c8-941c-4f96-b109-c7a919182027 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.437539] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-687c41c8-941c-4f96-b109-c7a919182027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.437761] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-687c41c8-941c-4f96-b109-c7a919182027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.438079] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-687c41c8-941c-4f96-b109-c7a919182027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.438258] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('687c41c8-941c-4f96-b109-c7a919182027',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.941059] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 687c41c8-941c-4f96-b109-c7a919182027 with status ACTIVE [ 1082.941357] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.941549] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.941583] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.941772] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.941870] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.942057] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.942160] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.942222] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.942375] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.942445] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.942661] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.942762] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.942824] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.942967] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.943073] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.943139] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 687c41c8-941c-4f96-b109-c7a919182027 is going to be updated. [ 1082.969113] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.973275] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.973275] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.973275] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.973275] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.973275] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-687c41c8-941c-4f96-b109-c7a919182027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.014431] env[70614]: INFO networking_nsxv3.common.synchronization [None req-91660a7c-85a3-4e1f-b42c-34a3835d37dc None None] Enqueued Resource ID: bd008bef-cf4b-411b-bbd4-7866ad894aaa with Priority: HIGHEST for action port [ 1083.014496] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd008bef-cf4b-411b-bbd4-7866ad894aaa with Priority: HIGHEST for action port [ 1083.014804] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-bd008bef-cf4b-411b-bbd4-7866ad894aaa taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.014922] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bd008bef-cf4b-411b-bbd4-7866ad894aaa" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.014986] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bd008bef-cf4b-411b-bbd4-7866ad894aaa" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.015319] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bd008bef-cf4b-411b-bbd4-7866ad894aaa" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.015397] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd008bef-cf4b-411b-bbd4-7866ad894aaa',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.517586] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bd008bef-cf4b-411b-bbd4-7866ad894aaa [ 1083.517838] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.518053] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.518172] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.518426] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.518567] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.518716] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bd008bef-cf4b-411b-bbd4-7866ad894aaa already deleted. [ 1083.518828] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bd008bef-cf4b-411b-bbd4-7866ad894aaa" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.628091] env[70614]: INFO networking_nsxv3.common.synchronization [None req-2187f42d-8350-4fea-a2fa-4fda54a2b754 tempest-ServerActionsTestJSON-366333930 tempest-ServerActionsTestJSON-366333930-project-member] Enqueued Resource ID: 3496e6be-51c4-4b7a-9789-b13bae7f2cda with Priority: HIGHEST for action security_group_rules [ 1083.628649] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3496e6be-51c4-4b7a-9789-b13bae7f2cda with Priority: HIGHEST for action security_group_rules [ 1083.628980] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3496e6be-51c4-4b7a-9789-b13bae7f2cda taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.629216] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3496e6be-51c4-4b7a-9789-b13bae7f2cda" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.629258] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3496e6be-51c4-4b7a-9789-b13bae7f2cda" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.629527] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3496e6be-51c4-4b7a-9789-b13bae7f2cda" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.629609] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3496e6be-51c4-4b7a-9789-b13bae7f2cda',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.738258] env[70614]: INFO networking_nsxv3.common.synchronization [None req-a92c536d-c2e5-4852-9645-4b345d2a40c7 tempest-ServerActionsTestJSON-366333930 tempest-ServerActionsTestJSON-366333930-project-member] Enqueued Resource ID: 3496e6be-51c4-4b7a-9789-b13bae7f2cda with Priority: HIGHEST for action security_group_rules [ 1083.738258] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3496e6be-51c4-4b7a-9789-b13bae7f2cda with Priority: HIGHEST for action security_group_rules [ 1083.738451] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3496e6be-51c4-4b7a-9789-b13bae7f2cda taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.738546] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3496e6be-51c4-4b7a-9789-b13bae7f2cda" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.777863] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1 in Status: SUCCESS [ 1083.778093] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.778252] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.778475] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.778661] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.778801] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.778871] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.779037] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.779119] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.779204] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.779299] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.780394] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.780560] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.780765] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.780871] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.780935] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.781097] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.781412] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.781412] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.157651] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.157859] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.157931] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.158157] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.158252] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.158352] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3496e6be-51c4-4b7a-9789-b13bae7f2cda already deleted. [ 1084.158592] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3496e6be-51c4-4b7a-9789-b13bae7f2cda" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.158789] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3496e6be-51c4-4b7a-9789-b13bae7f2cda" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.158965] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3496e6be-51c4-4b7a-9789-b13bae7f2cda" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.159067] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3496e6be-51c4-4b7a-9789-b13bae7f2cda',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.283654] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.283844] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.284076] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.570060] env[70614]: INFO networking_nsxv3.common.synchronization [req-e25d6eeb-6df3-46e7-a3d8-dfafe8c529f7 req-ba7e2212-ef87-4e6a-b0d5-df0cbfbf4b20 tempest-AttachVolumeTestJSON-892346173 tempest-AttachVolumeTestJSON-892346173-project-member] Enqueued Resource ID: a9ca3845-322a-44b9-bb41-74f7ea3d04f7 with Priority: HIGHEST for action security_group_members [ 1084.570060] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9ca3845-322a-44b9-bb41-74f7ea3d04f7 with Priority: HIGHEST for action security_group_members [ 1084.570060] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9ca3845-322a-44b9-bb41-74f7ea3d04f7 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.570060] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9ca3845-322a-44b9-bb41-74f7ea3d04f7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.570060] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9ca3845-322a-44b9-bb41-74f7ea3d04f7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.570060] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9ca3845-322a-44b9-bb41-74f7ea3d04f7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.572016] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.572016] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.572111] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.572421] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.572560] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.572736] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9ca3845-322a-44b9-bb41-74f7ea3d04f7',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.681811] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.681966] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.682054] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.682344] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.682406] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.682472] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3496e6be-51c4-4b7a-9789-b13bae7f2cda already deleted. [ 1084.682551] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3496e6be-51c4-4b7a-9789-b13bae7f2cda" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.789876] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.075557] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.075915] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.075915] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.076016] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.076109] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.076554] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.076554] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.076554] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.076554] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.076889] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.076889] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9ca3845-322a-44b9-bb41-74f7ea3d04f7 is going to be updated. [ 1085.106744] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.106948] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.106948] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.107184] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.107332] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.118369] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9ca3845-322a-44b9-bb41-74f7ea3d04f7 in Status: IN_PROGRESS for 2s [ 1085.296780] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.297011] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.297138] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.297430] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.297555] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.297695] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1 is going to be updated. [ 1085.334741] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.334937] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.335052] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.335394] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.335620] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.346508] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1 in Status: IN_PROGRESS for 2s [ 1087.009033] env[70614]: INFO networking_nsxv3.common.synchronization [req-88e284d3-febe-4f39-b020-342ef69a5e51 req-bf02ca0c-9bff-43a3-88c0-d97a21e68200 tempest-ServerDiskConfigTestJSON-2045015546 tempest-ServerDiskConfigTestJSON-2045015546-project-member] Enqueued Resource ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 with Priority: HIGHEST for action security_group_members [ 1087.009033] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 with Priority: HIGHEST for action security_group_members [ 1087.009033] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.009458] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.009458] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.009617] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.009865] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.010047] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.010313] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.010490] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.010578] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.010735] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94eb8a38-d1bf-4747-a73b-c4d0ea236bc3',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.130636] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9ca3845-322a-44b9-bb41-74f7ea3d04f7 in Status: IN_PROGRESS for 4s [ 1087.338862] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-498 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.339084] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-498" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.339215] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-498" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.339564] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-498" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.339892] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.340079] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.340207] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.340426] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.340576] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.340789] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1087.340931] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1087.341062] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1087.341176] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1087.341293] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1087.341530] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1087.341530] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1087.356029] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1 in Status: SUCCESS [ 1087.356242] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.356434] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.356653] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.356832] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.356947] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.357020] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.357187] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.357273] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.357357] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.361261] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1087.361416] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1087.361557] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1087.361726] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-498" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.362033] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-4e433e82-c6c3-4860-a7b5-1331e4e0182b taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.362241] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-4e433e82-c6c3-4860-a7b5-1331e4e0182b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.362367] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-4e433e82-c6c3-4860-a7b5-1331e4e0182b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.362665] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-4e433e82-c6c3-4860-a7b5-1331e4e0182b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.362806] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e433e82-c6c3-4860-a7b5-1331e4e0182b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.512847] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.513092] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.513092] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.513295] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.513478] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.513670] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.513771] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.513834] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.514032] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.514089] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.514246] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 already deleted. [ 1087.514799] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.860948] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.867119] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.867694] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.867739] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.868163] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.868407] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.868674] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 4e433e82-c6c3-4860-a7b5-1331e4e0182b not found, creating... [ 1087.868889] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.869035] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.869194] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.869832] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.869832] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.869938] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.870100] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.870227] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.870599] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.870599] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.870720] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 4e433e82-c6c3-4860-a7b5-1331e4e0182b is going to be created. [ 1087.898069] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.898316] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.898454] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.898774] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.899060] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.899321] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-4e433e82-c6c3-4860-a7b5-1331e4e0182b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.363715] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.654438] env[70614]: INFO networking_nsxv3.common.synchronization [req-88e284d3-febe-4f39-b020-342ef69a5e51 req-d42a6584-7de9-4139-a827-2e803f887319 service nova] Enqueued Resource ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 with Priority: HIGHEST for action security_group_rules [ 1088.654961] env[70614]: INFO networking_nsxv3.common.synchronization [req-88e284d3-febe-4f39-b020-342ef69a5e51 req-d42a6584-7de9-4139-a827-2e803f887319 service nova] Enqueued Resource ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 with Priority: HIGHEST for action security_group_members [ 1088.655255] env[70614]: INFO networking_nsxv3.common.synchronization [req-88e284d3-febe-4f39-b020-342ef69a5e51 req-d42a6584-7de9-4139-a827-2e803f887319 service nova] Enqueued Resource ID: 4e433e82-c6c3-4860-a7b5-1331e4e0182b with Priority: HIGHEST for action port [ 1088.655919] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 with Priority: HIGHEST for action security_group_rules [ 1088.656270] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 with Priority: HIGHEST for action security_group_members [ 1088.656467] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e433e82-c6c3-4860-a7b5-1331e4e0182b with Priority: HIGHEST for action port [ 1088.656852] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.657641] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.657800] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.658142] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.658318] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('94eb8a38-d1bf-4747-a73b-c4d0ea236bc3',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.659850] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.660124] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.660273] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.660521] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.660761] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.660968] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.661130] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.661434] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.662591] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.662591] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94eb8a38-d1bf-4747-a73b-c4d0ea236bc3',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.663916] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e433e82-c6c3-4860-a7b5-1331e4e0182b taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.664060] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e433e82-c6c3-4860-a7b5-1331e4e0182b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.664144] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e433e82-c6c3-4860-a7b5-1331e4e0182b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.664329] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e433e82-c6c3-4860-a7b5-1331e4e0182b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.664444] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e433e82-c6c3-4860-a7b5-1331e4e0182b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.869780] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.869780] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.869780] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.869780] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.869995] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.869995] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1 is going to be updated. [ 1088.900175] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.900175] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.900175] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.900175] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.900175] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.909275] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1 in Status: IN_PROGRESS for 2s [ 1089.141943] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9ca3845-322a-44b9-bb41-74f7ea3d04f7 in Status: SUCCESS [ 1089.141943] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9ca3845-322a-44b9-bb41-74f7ea3d04f7 deletion is rescheduled due to dependency. [ 1089.141943] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9ca3845-322a-44b9-bb41-74f7ea3d04f7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.161201] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.161201] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.165288] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('94eb8a38-d1bf-4747-a73b-c4d0ea236bc3',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.167351] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4e433e82-c6c3-4860-a7b5-1331e4e0182b with status ACTIVE [ 1089.171106] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.171106] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.171106] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.171106] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.171106] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.171106] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.171106] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.171106] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.171106] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.171106] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.171106] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.171106] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.171106] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.171106] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.171106] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.171106] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4e433e82-c6c3-4860-a7b5-1331e4e0182b is going to be updated. [ 1089.201121] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.201325] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.201325] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.201966] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.201966] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.201966] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e433e82-c6c3-4860-a7b5-1331e4e0182b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.243959] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-385 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.244204] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-385" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.244382] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-385" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.244688] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-385" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.244963] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.245140] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.245259] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.245483] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.245633] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.245843] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1089.245962] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1089.246087] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1089.246295] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1089.246295] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1089.246399] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1089.246535] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1089.271709] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1089.271888] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1089.272082] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1089.272276] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-385" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.272599] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-0ae70826-e27e-468b-a7e9-cefff160de53 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.272771] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-0ae70826-e27e-468b-a7e9-cefff160de53" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.272967] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-0ae70826-e27e-468b-a7e9-cefff160de53" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.273189] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-0ae70826-e27e-468b-a7e9-cefff160de53" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.273333] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ae70826-e27e-468b-a7e9-cefff160de53',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.667060] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('94eb8a38-d1bf-4747-a73b-c4d0ea236bc3',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.776273] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.776663] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.776822] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.777223] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.777433] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.777855] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.778087] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.778259] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.778599] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.778812] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.779257] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.779508] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.779702] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.780047] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.780233] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.780430] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 0ae70826-e27e-468b-a7e9-cefff160de53 is going to be updated. [ 1089.802670] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.802863] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.802994] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.803289] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.803496] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.803729] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-0ae70826-e27e-468b-a7e9-cefff160de53" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.170733] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.171053] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.171250] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.171586] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.171756] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.171953] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 is going to be created. [ 1090.207012] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.207198] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.207198] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.207401] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.207581] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.218857] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 in Status: UNINITIALIZED for 2s [ 1090.503556] env[70614]: INFO networking_nsxv3.common.synchronization [req-29e91bd0-0048-4458-8729-68ced3a52c62 req-a83aab63-e11c-4cb2-a4f2-5da4c0bacff9 service nova] Enqueued Resource ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 with Priority: HIGHEST for action security_group_rules [ 1090.503556] env[70614]: INFO networking_nsxv3.common.synchronization [req-29e91bd0-0048-4458-8729-68ced3a52c62 req-a83aab63-e11c-4cb2-a4f2-5da4c0bacff9 service nova] Enqueued Resource ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 with Priority: HIGHEST for action security_group_members [ 1090.503556] env[70614]: INFO networking_nsxv3.common.synchronization [req-29e91bd0-0048-4458-8729-68ced3a52c62 req-a83aab63-e11c-4cb2-a4f2-5da4c0bacff9 service nova] Enqueued Resource ID: 0ae70826-e27e-468b-a7e9-cefff160de53 with Priority: HIGHEST for action port [ 1090.503556] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 with Priority: HIGHEST for action security_group_rules [ 1090.503556] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 with Priority: HIGHEST for action security_group_members [ 1090.503556] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ae70826-e27e-468b-a7e9-cefff160de53 with Priority: HIGHEST for action port [ 1090.504597] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d3a5ad0-c473-4d61-9101-9c7582c27390 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.505284] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.505599] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.505599] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.505724] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d3a5ad0-c473-4d61-9101-9c7582c27390',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.506642] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d3a5ad0-c473-4d61-9101-9c7582c27390 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.506878] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.506878] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.507043] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.507235] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.507334] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.507393] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.507544] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.507630] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.507752] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d3a5ad0-c473-4d61-9101-9c7582c27390',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.508863] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-0ae70826-e27e-468b-a7e9-cefff160de53 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.508863] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0ae70826-e27e-468b-a7e9-cefff160de53" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.508863] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0ae70826-e27e-468b-a7e9-cefff160de53" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.509063] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0ae70826-e27e-468b-a7e9-cefff160de53" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.509171] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ae70826-e27e-468b-a7e9-cefff160de53',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.921721] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1 in Status: SUCCESS [ 1090.922635] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.922635] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.923310] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.923745] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.923979] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.924172] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.924542] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.924913] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.925018] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.925455] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.925732] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.925905] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.926332] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.926727] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.926987] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.927183] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.927558] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.927693] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.927864] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.928043] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.011999] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d3a5ad0-c473-4d61-9101-9c7582c27390',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.013039] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d3a5ad0-c473-4d61-9101-9c7582c27390 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.013039] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.013039] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0ae70826-e27e-468b-a7e9-cefff160de53 with status ACTIVE [ 1091.013264] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.013264] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.013375] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.013544] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.013644] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.013851] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.013955] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.014015] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.014191] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.014191] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.014415] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.014560] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.014560] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.014737] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.014820] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.014924] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0ae70826-e27e-468b-a7e9-cefff160de53 is going to be updated. [ 1091.067736] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.067930] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.068038] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.068833] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.068833] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.068833] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0ae70826-e27e-468b-a7e9-cefff160de53" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.430881] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1: rpc.has_security_group_logging(os_id): False [ 1091.449721] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.449956] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.450021] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.450300] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.450834] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.450834] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.450834] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.450834] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.451058] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.451108] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.451310] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.451403] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.451467] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.451609] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.451682] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.451871] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.451963] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.452034] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.452175] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.452247] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.452331] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1 is going to be created. [ 1091.520029] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.520029] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.520029] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.520029] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.520029] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.520029] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d3a5ad0-c473-4d61-9101-9c7582c27390',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.534239] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1 in Status: IN_PROGRESS for 2s [ 1091.589573] env[70614]: INFO networking_nsxv3.common.synchronization [req-90fc6be7-8eea-437c-9346-f0bc70826344 req-23927e51-9d1b-4576-94c1-8cf66e4d79f3 tempest-ServerActionsTestJSON-366333930 tempest-ServerActionsTestJSON-366333930-project-member] Enqueued Resource ID: 3496e6be-51c4-4b7a-9789-b13bae7f2cda with Priority: HIGHEST for action security_group_members [ 1091.590199] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3496e6be-51c4-4b7a-9789-b13bae7f2cda with Priority: HIGHEST for action security_group_members [ 1091.590592] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-3496e6be-51c4-4b7a-9789-b13bae7f2cda taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.590737] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3496e6be-51c4-4b7a-9789-b13bae7f2cda" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.590807] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3496e6be-51c4-4b7a-9789-b13bae7f2cda" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.591103] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3496e6be-51c4-4b7a-9789-b13bae7f2cda" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.591270] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.591373] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.591437] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.591593] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.591679] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.591775] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3496e6be-51c4-4b7a-9789-b13bae7f2cda',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.880735] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-117 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.880735] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-117" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.880735] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-117" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.880735] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-117" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.880735] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.880735] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.880735] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.880735] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.880735] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.880735] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1091.881405] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1091.881405] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1091.881405] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1091.881405] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1091.881405] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1091.881405] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1091.901712] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1091.901913] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1091.902073] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1091.903411] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-117" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.903411] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-f371f219-8216-49b7-882e-b27e0712ac72 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.903411] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-f371f219-8216-49b7-882e-b27e0712ac72" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.903411] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-f371f219-8216-49b7-882e-b27e0712ac72" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.903411] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-f371f219-8216-49b7-882e-b27e0712ac72" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.903651] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f371f219-8216-49b7-882e-b27e0712ac72',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.020896] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.021255] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.021255] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.022500] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.022500] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.022500] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 is going to be updated. [ 1092.074297] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.074503] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.074544] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.074830] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.074988] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.086171] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 in Status: IN_PROGRESS for 2s [ 1092.093754] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.093937] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.094019] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.094252] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.094373] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.094586] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.094767] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.094907] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.095062] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.095259] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.095259] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3496e6be-51c4-4b7a-9789-b13bae7f2cda already deleted. [ 1092.095381] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3496e6be-51c4-4b7a-9789-b13bae7f2cda" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.231358] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 in Status: SUCCESS [ 1092.231713] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.231978] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.232369] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.232651] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.232847] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.232955] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.233222] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.233351] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.233488] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.233631] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('94eb8a38-d1bf-4747-a73b-c4d0ea236bc3',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.406527] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.406858] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.407175] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.407660] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.407927] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.408201] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port f371f219-8216-49b7-882e-b27e0712ac72 not found, creating... [ 1092.408864] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.409155] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.409349] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.410059] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.410209] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.410662] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.410916] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.411120] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.411460] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.411680] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.411940] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: f371f219-8216-49b7-882e-b27e0712ac72 is going to be created. [ 1092.434462] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.434698] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.434964] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.435170] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.435415] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.435740] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-f371f219-8216-49b7-882e-b27e0712ac72" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.740025] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.740025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.740025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.740025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.740025] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.740025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.740025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.740025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.740025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.740025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.740025] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.740025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.740025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.740025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.740025] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.740025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.741024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.741401] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.741737] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.742089] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.742411] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('94eb8a38-d1bf-4747-a73b-c4d0ea236bc3',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.136365] env[70614]: INFO networking_nsxv3.common.synchronization [req-90fc6be7-8eea-437c-9346-f0bc70826344 req-a2bface1-58bb-4652-bd20-7b60e90b33eb service nova] Enqueued Resource ID: 3496e6be-51c4-4b7a-9789-b13bae7f2cda with Priority: HIGHEST for action security_group_rules [ 1093.136807] env[70614]: INFO networking_nsxv3.common.synchronization [req-90fc6be7-8eea-437c-9346-f0bc70826344 req-a2bface1-58bb-4652-bd20-7b60e90b33eb service nova] Enqueued Resource ID: 3496e6be-51c4-4b7a-9789-b13bae7f2cda with Priority: HIGHEST for action security_group_members [ 1093.136982] env[70614]: INFO networking_nsxv3.common.synchronization [req-90fc6be7-8eea-437c-9346-f0bc70826344 req-a2bface1-58bb-4652-bd20-7b60e90b33eb service nova] Enqueued Resource ID: f371f219-8216-49b7-882e-b27e0712ac72 with Priority: HIGHEST for action port [ 1093.137620] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3496e6be-51c4-4b7a-9789-b13bae7f2cda with Priority: HIGHEST for action security_group_rules [ 1093.137782] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3496e6be-51c4-4b7a-9789-b13bae7f2cda with Priority: HIGHEST for action security_group_members [ 1093.137890] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f371f219-8216-49b7-882e-b27e0712ac72 with Priority: HIGHEST for action port [ 1093.138511] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3496e6be-51c4-4b7a-9789-b13bae7f2cda taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.138646] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3496e6be-51c4-4b7a-9789-b13bae7f2cda" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.138714] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3496e6be-51c4-4b7a-9789-b13bae7f2cda" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.139078] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3496e6be-51c4-4b7a-9789-b13bae7f2cda" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.139078] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3496e6be-51c4-4b7a-9789-b13bae7f2cda',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.140094] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-3496e6be-51c4-4b7a-9789-b13bae7f2cda taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.140215] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3496e6be-51c4-4b7a-9789-b13bae7f2cda" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.140276] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3496e6be-51c4-4b7a-9789-b13bae7f2cda" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.140582] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3496e6be-51c4-4b7a-9789-b13bae7f2cda" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.140759] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.140854] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.140904] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.141119] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.141217] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.141366] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3496e6be-51c4-4b7a-9789-b13bae7f2cda',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.142283] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-f371f219-8216-49b7-882e-b27e0712ac72 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.142736] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f371f219-8216-49b7-882e-b27e0712ac72" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.142736] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f371f219-8216-49b7-882e-b27e0712ac72" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.142736] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f371f219-8216-49b7-882e-b27e0712ac72" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.142736] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f371f219-8216-49b7-882e-b27e0712ac72',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.246601] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3: rpc.has_security_group_logging(os_id): False [ 1093.267398] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.267833] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.267833] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.268090] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.268209] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.268425] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.268521] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.268593] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.268779] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.268860] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.269134] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.269239] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.269295] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.269442] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.269515] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.269716] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.269811] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.269932] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.270165] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.270278] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.270371] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 is going to be created. [ 1093.358728] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.358919] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.358919] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.359121] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.359454] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.371981] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 in Status: IN_PROGRESS for 2s [ 1093.552537] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1 in Status: SUCCESS [ 1093.552698] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.552884] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.553148] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.553247] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.645021] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3496e6be-51c4-4b7a-9789-b13bae7f2cda',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.646121] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-3496e6be-51c4-4b7a-9789-b13bae7f2cda taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.646263] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3496e6be-51c4-4b7a-9789-b13bae7f2cda" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.646700] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f371f219-8216-49b7-882e-b27e0712ac72 with status ACTIVE [ 1093.646866] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.646982] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.647061] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.647257] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.647339] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.647505] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.647601] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.647654] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.647811] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.647870] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.648067] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.648164] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.648218] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.648362] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.648482] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.648521] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f371f219-8216-49b7-882e-b27e0712ac72 is going to be updated. [ 1093.669235] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.669473] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.669473] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.669623] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.669754] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.669991] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f371f219-8216-49b7-882e-b27e0712ac72" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.055879] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.056131] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.056207] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.056423] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.056594] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.056694] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.056759] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.056905] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.056990] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.057094] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.057184] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.096834] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 in Status: SUCCESS [ 1094.097116] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.097484] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.098053] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.098053] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.098053] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.098053] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.098270] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.098506] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.098645] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.099394] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6d3a5ad0-c473-4d61-9101-9c7582c27390',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.150370] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3496e6be-51c4-4b7a-9789-b13bae7f2cda',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.560573] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.560768] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.560768] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.561032] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.561248] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.561389] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.561471] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.561676] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.561768] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.561861] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.562067] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.562190] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.562253] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.562400] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.562548] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.562692] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.562785] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.562992] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.563127] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.563253] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.563390] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.601052] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d3a5ad0-c473-4d61-9101-9c7582c27390 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.601229] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.601312] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.601527] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.601702] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.601802] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.601866] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.602023] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.602113] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.602203] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.602357] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d3a5ad0-c473-4d61-9101-9c7582c27390 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.602587] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.602587] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.602664] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.603395] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.603395] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.603395] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.603395] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.603395] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.603395] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.603395] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6d3a5ad0-c473-4d61-9101-9c7582c27390',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.654100] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.654100] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.654100] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.654100] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.654519] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.654519] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3496e6be-51c4-4b7a-9789-b13bae7f2cda is going to be created. [ 1094.680764] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.680995] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.680995] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.681256] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.681436] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.691460] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3496e6be-51c4-4b7a-9789-b13bae7f2cda in Status: UNINITIALIZED for 2s [ 1095.067066] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1: rpc.has_security_group_logging(os_id): False [ 1095.084261] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.084433] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.084510] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.084762] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.084863] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.085074] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.085174] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.085238] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.085396] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.085473] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.085666] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.085779] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.085864] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.086026] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.086105] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.086320] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.086416] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.086478] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.086618] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.086692] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.086779] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1 is going to be updated. [ 1095.105691] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6d3a5ad0-c473-4d61-9101-9c7582c27390: rpc.has_security_group_logging(os_id): False [ 1095.124596] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.124596] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.124596] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.124865] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.124865] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.125085] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.125191] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.125257] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.125411] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.125491] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.125678] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.125795] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.125863] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.126063] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.126157] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.126351] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.126450] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.126514] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.126668] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.126738] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.126829] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 is going to be updated. [ 1095.156884] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.157570] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.157570] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.157570] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.157570] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.168698] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1 in Status: IN_PROGRESS for 2s [ 1095.193054] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.193267] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.193267] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.193490] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.194061] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.222926] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 in Status: IN_PROGRESS for 2s [ 1095.385052] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 in Status: SUCCESS [ 1095.385301] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.703053] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3496e6be-51c4-4b7a-9789-b13bae7f2cda in Status: SUCCESS [ 1096.703437] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3496e6be-51c4-4b7a-9789-b13bae7f2cda" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.703588] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3496e6be-51c4-4b7a-9789-b13bae7f2cda" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.703897] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3496e6be-51c4-4b7a-9789-b13bae7f2cda" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.704231] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.704415] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.704513] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.704754] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.704877] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.705175] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3496e6be-51c4-4b7a-9789-b13bae7f2cda" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.705373] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3496e6be-51c4-4b7a-9789-b13bae7f2cda',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.798657] env[70614]: INFO networking_nsxv3.common.synchronization [None req-c4bbc511-cf16-4646-830b-f8336d562b2b tempest-AttachVolumeTestJSON-892346173 tempest-AttachVolumeTestJSON-892346173-project-member] Enqueued Resource ID: 57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e with Priority: HIGHEST for action security_group_rules [ 1096.799791] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e with Priority: HIGHEST for action security_group_rules [ 1096.800227] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.800362] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.800453] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.800853] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.801008] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.908387] env[70614]: INFO networking_nsxv3.common.synchronization [None req-d71183d3-503a-4bc3-ab6a-00468e300240 tempest-AttachVolumeTestJSON-892346173 tempest-AttachVolumeTestJSON-892346173-project-member] Enqueued Resource ID: 57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e with Priority: HIGHEST for action security_group_rules [ 1096.908945] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e with Priority: HIGHEST for action security_group_rules [ 1096.909397] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.909397] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.186081] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1 in Status: SUCCESS [ 1097.186331] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.209039] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3496e6be-51c4-4b7a-9789-b13bae7f2cda',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.245462] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 in Status: SUCCESS [ 1097.245705] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.323075] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.323075] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.323075] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.323075] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.323364] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.323364] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e already deleted. [ 1097.323364] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.323485] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.323692] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.323692] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.712338] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3496e6be-51c4-4b7a-9789-b13bae7f2cda: rpc.has_security_group_logging(os_id): False [ 1097.731137] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.731318] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.731369] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.731546] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.731629] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.731869] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.731968] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.732028] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.732187] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.732246] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.732363] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3496e6be-51c4-4b7a-9789-b13bae7f2cda is going to be created. [ 1097.808215] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.808477] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.808601] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.808852] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.809269] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.821804] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3496e6be-51c4-4b7a-9789-b13bae7f2cda in Status: IN_PROGRESS for 2s [ 1097.855044] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.855393] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.855469] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.855710] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.855800] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.855901] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e already deleted. [ 1097.855989] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.987271] env[70614]: INFO networking_nsxv3.common.synchronization [req-3913a303-0120-4320-a6aa-c6b3afc95aed req-e17a6565-e4a8-4ab0-90b1-8512f4882885 tempest-DeleteServersTestJSON-1690139659 tempest-DeleteServersTestJSON-1690139659-project-member] Enqueued Resource ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f with Priority: HIGHEST for action security_group_members [ 1098.987964] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f with Priority: HIGHEST for action security_group_members [ 1098.988435] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.988606] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.988681] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.988920] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.989156] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.989266] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.989336] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.989795] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.989795] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.989795] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df8f20f5-6e92-4ac4-bdd2-05863ac4905f',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.492554] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.492741] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.492784] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.493071] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.493184] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.493391] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.493507] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.493564] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.493769] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.493877] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.493921] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f is going to be updated. [ 1099.525223] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.525399] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.525460] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.525661] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.525840] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.535316] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f in Status: IN_PROGRESS for 2s [ 1099.833840] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3496e6be-51c4-4b7a-9789-b13bae7f2cda in Status: SUCCESS [ 1099.834095] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3496e6be-51c4-4b7a-9789-b13bae7f2cda" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.546861] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f in Status: SUCCESS [ 1101.547656] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f deletion is rescheduled due to dependency. [ 1101.547656] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.117669] env[70614]: INFO networking_nsxv3.common.synchronization [req-3a25a4f4-9040-4132-a70c-3080959bc95d req-4601fa88-cf40-41b9-9131-a1312e1167d8 tempest-AttachVolumeTestJSON-892346173 tempest-AttachVolumeTestJSON-892346173-project-member] Enqueued Resource ID: 57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e with Priority: HIGHEST for action security_group_members [ 1103.118250] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e with Priority: HIGHEST for action security_group_members [ 1103.118553] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.118691] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.118747] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.119290] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.120038] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.120038] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.120038] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.120038] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.120038] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.120307] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.625211] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.625211] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.625211] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.625211] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.625211] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.625441] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.625491] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.625550] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.625700] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.625773] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.625856] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e already deleted. [ 1103.625943] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.905268] env[70614]: INFO networking_nsxv3.common.synchronization [req-ef3f5339-ab3c-4bb3-b7ef-c086b985ba41 req-b4dabb0a-7d57-4007-b90f-7a84fddc861d tempest-ServersNegativeTestJSON-1078216700 tempest-ServersNegativeTestJSON-1078216700-project-member] Enqueued Resource ID: 4be97761-0b55-45fd-ba63-8ef18d95b9f2 with Priority: HIGHEST for action security_group_members [ 1103.906438] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4be97761-0b55-45fd-ba63-8ef18d95b9f2 with Priority: HIGHEST for action security_group_members [ 1103.907256] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-168 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.907440] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-168" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.907561] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-168" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.907851] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-168" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.908444] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.908739] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.908971] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.909934] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.909934] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.909934] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1103.910195] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1103.910195] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1103.910414] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1103.910414] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1103.910491] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1103.910693] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1103.911732] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-4be97761-0b55-45fd-ba63-8ef18d95b9f2 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.911885] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.911885] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.912119] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.912299] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.912419] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.912481] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.912631] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.912714] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.912806] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4be97761-0b55-45fd-ba63-8ef18d95b9f2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.937445] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1103.937756] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1103.937912] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1103.938184] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-168" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.938537] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-fea48703-b66c-4013-afa8-cbecdd0c6180 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.938818] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-fea48703-b66c-4013-afa8-cbecdd0c6180" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.939319] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-fea48703-b66c-4013-afa8-cbecdd0c6180" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.939582] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-fea48703-b66c-4013-afa8-cbecdd0c6180" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.939723] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fea48703-b66c-4013-afa8-cbecdd0c6180',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.415480] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.415868] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.415868] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.415950] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.416050] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.416216] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.416318] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.416400] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.416538] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.416616] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.416702] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4be97761-0b55-45fd-ba63-8ef18d95b9f2 is going to be updated. [ 1104.441553] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.441860] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.442060] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.442410] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.442618] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.442823] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port fea48703-b66c-4013-afa8-cbecdd0c6180 not found, creating... [ 1104.443206] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.443758] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.443758] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.443907] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.444010] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.444326] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.444599] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.444709] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.444897] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.445048] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.445251] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: fea48703-b66c-4013-afa8-cbecdd0c6180 is going to be created. [ 1104.447583] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.447583] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.447806] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.447914] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.448097] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.461562] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4be97761-0b55-45fd-ba63-8ef18d95b9f2 in Status: IN_PROGRESS for 2s [ 1104.470846] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.471075] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.471197] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.471481] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.471764] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.471943] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-fea48703-b66c-4013-afa8-cbecdd0c6180" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.205091] env[70614]: INFO networking_nsxv3.common.synchronization [req-3a25a4f4-9040-4132-a70c-3080959bc95d req-a40cac84-c712-464b-82fa-4480cf2bc523 service nova] Enqueued Resource ID: 57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e with Priority: HIGHEST for action security_group_rules [ 1105.205288] env[70614]: INFO networking_nsxv3.common.synchronization [req-3a25a4f4-9040-4132-a70c-3080959bc95d req-a40cac84-c712-464b-82fa-4480cf2bc523 service nova] Enqueued Resource ID: 57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e with Priority: HIGHEST for action security_group_members [ 1105.205431] env[70614]: INFO networking_nsxv3.common.synchronization [req-3a25a4f4-9040-4132-a70c-3080959bc95d req-a40cac84-c712-464b-82fa-4480cf2bc523 service nova] Enqueued Resource ID: fea48703-b66c-4013-afa8-cbecdd0c6180 with Priority: HIGHEST for action port [ 1105.205657] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e with Priority: HIGHEST for action security_group_rules [ 1105.205781] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e with Priority: HIGHEST for action security_group_members [ 1105.205875] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fea48703-b66c-4013-afa8-cbecdd0c6180 with Priority: HIGHEST for action port [ 1105.206484] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.206621] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.206690] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.206892] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.206976] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.207987] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.208079] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.208124] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.208287] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.208427] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.208517] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.208614] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.208723] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.208796] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.208872] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.210539] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-fea48703-b66c-4013-afa8-cbecdd0c6180 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.210539] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fea48703-b66c-4013-afa8-cbecdd0c6180" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.210539] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fea48703-b66c-4013-afa8-cbecdd0c6180" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.210539] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fea48703-b66c-4013-afa8-cbecdd0c6180" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.210539] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fea48703-b66c-4013-afa8-cbecdd0c6180',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.712689] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.716082] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.716082] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.716082] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fea48703-b66c-4013-afa8-cbecdd0c6180 with status ACTIVE [ 1105.716082] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.716082] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.716378] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.716714] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.717010] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.717430] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.717737] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.717867] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.718250] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.718531] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.718938] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.719307] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.719413] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.719818] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.720107] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.720358] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fea48703-b66c-4013-afa8-cbecdd0c6180 is going to be updated. [ 1105.747148] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.747334] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.747488] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.747981] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.748250] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.748473] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fea48703-b66c-4013-afa8-cbecdd0c6180" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.216575] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.472131] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4be97761-0b55-45fd-ba63-8ef18d95b9f2 in Status: SUCCESS [ 1106.472387] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4be97761-0b55-45fd-ba63-8ef18d95b9f2 deletion is rescheduled due to dependency. [ 1106.472508] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.722033] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.722440] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.722440] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.722750] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.722949] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.723379] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e is going to be created. [ 1106.756034] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.756034] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.756256] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.756355] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.756509] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.767737] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e in Status: UNINITIALIZED for 2s [ 1108.118253] env[70614]: INFO networking_nsxv3.common.synchronization [req-758fbdb2-c77c-4f25-b8b7-03503f6b7596 req-5aa18029-8abf-450c-93aa-4a5236173ebb tempest-AttachInterfacesTestJSON-1919943007 tempest-AttachInterfacesTestJSON-1919943007-project-member] Enqueued Resource ID: ca55d9c7-11be-476b-bdb5-63e4c956a4de with Priority: HIGHEST for action security_group_members [ 1108.118785] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca55d9c7-11be-476b-bdb5-63e4c956a4de with Priority: HIGHEST for action security_group_members [ 1108.119095] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca55d9c7-11be-476b-bdb5-63e4c956a4de taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.119213] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca55d9c7-11be-476b-bdb5-63e4c956a4de" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.119279] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca55d9c7-11be-476b-bdb5-63e4c956a4de" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.119485] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca55d9c7-11be-476b-bdb5-63e4c956a4de" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.119633] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.119729] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.120072] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.120072] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.120189] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.120189] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca55d9c7-11be-476b-bdb5-63e4c956a4de',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.622874] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca55d9c7-11be-476b-bdb5-63e4c956a4de',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.783154] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e in Status: SUCCESS [ 1108.783397] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.783578] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.783926] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.784162] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.784268] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.784268] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.784427] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.784511] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.784599] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.784694] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.127936] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca55d9c7-11be-476b-bdb5-63e4c956a4de',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.288104] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.631980] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.632345] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.632492] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.632893] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.633563] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.633563] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca55d9c7-11be-476b-bdb5-63e4c956a4de is going to be updated. [ 1109.682579] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.682579] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.682772] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.686027] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.686027] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.699715] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca55d9c7-11be-476b-bdb5-63e4c956a4de in Status: IN_PROGRESS for 2s [ 1109.792657] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e: rpc.has_security_group_logging(os_id): False [ 1109.818055] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.818264] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.818313] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.818670] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.818670] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.819062] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.819062] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.819173] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.819428] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.819428] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.819570] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e is going to be created. [ 1109.895249] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.895732] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.895732] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.895732] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.896196] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.912461] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e in Status: IN_PROGRESS for 2s [ 1111.718237] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca55d9c7-11be-476b-bdb5-63e4c956a4de in Status: SUCCESS [ 1111.718610] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca55d9c7-11be-476b-bdb5-63e4c956a4de" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.929149] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e in Status: SUCCESS [ 1111.929433] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.224759] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.225092] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.225092] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.225432] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.225432] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.728300] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.953598] env[70614]: INFO networking_nsxv3.common.synchronization [None req-04164067-0bea-482c-83ae-b72fd985cf53 None None] Enqueued Resource ID: 45774a4a-36c2-4826-abc1-6ce930c76c5c with Priority: HIGHEST for action port [ 1112.953976] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45774a4a-36c2-4826-abc1-6ce930c76c5c with Priority: HIGHEST for action port [ 1112.954456] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-45774a4a-36c2-4826-abc1-6ce930c76c5c taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.954575] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-45774a4a-36c2-4826-abc1-6ce930c76c5c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.954910] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-45774a4a-36c2-4826-abc1-6ce930c76c5c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.955492] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-45774a4a-36c2-4826-abc1-6ce930c76c5c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.955603] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45774a4a-36c2-4826-abc1-6ce930c76c5c',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.059816] env[70614]: INFO networking_nsxv3.common.synchronization [req-2c246a19-5a4f-47b6-b204-0b258c61d8c7 req-364c25af-0bb7-4cd4-9677-2ca46112aa50 tempest-ServerDiskConfigTestJSON-2045015546 tempest-ServerDiskConfigTestJSON-2045015546-project-member] Enqueued Resource ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 with Priority: HIGHEST for action security_group_members [ 1113.060374] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 with Priority: HIGHEST for action security_group_members [ 1113.060669] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.060790] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.060869] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.061130] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.061331] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.061433] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.061489] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.061651] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.061737] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.061830] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94eb8a38-d1bf-4747-a73b-c4d0ea236bc3',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.232730] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.459172] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 45774a4a-36c2-4826-abc1-6ce930c76c5c [ 1113.459511] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.459708] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.459811] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.460171] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.460310] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.460458] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:45774a4a-36c2-4826-abc1-6ce930c76c5c already deleted. [ 1113.460594] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-45774a4a-36c2-4826-abc1-6ce930c76c5c" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.564260] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.564611] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.564804] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.565100] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.565773] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.565773] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.565973] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.566076] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.566294] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.566429] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.566578] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 is going to be updated. [ 1113.595423] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.595423] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.595423] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.595876] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.595876] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.606356] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 in Status: IN_PROGRESS for 2s [ 1113.734478] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1113.734838] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1114.667422] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.667570] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.667643] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.667849] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.683212] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1114.684039] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.684934] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1114.730037] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.730257] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.730457] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.730556] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.744139] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.744991] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1114.745112] env[70614]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=70614) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1114.745236] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1114.792424] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.792584] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.792682] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.792871] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.794554] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.794809] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1114.901681] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.901681] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.901681] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.901681] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.902164] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.902227] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1114.987758] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.987947] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.988065] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.988300] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.988707] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.988897] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:50. [ 1114.989041] env[70614]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'4e54f39e-349d-49ad-bb07-348488d846f0', '49dd754e-129e-49c8-9e52-09796cb64337', '7ea2558c-aa82-4694-8be9-307b8ca3e536', '57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e', 'abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b', '3060abf5-a0d6-4fce-88da-15f03f632b6e', 'def9aa42-470d-498e-9034-6879fb1e6ebc', '0a55332f-b291-4614-8b34-ee4cd0d39027', '0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62', 'ca55d9c7-11be-476b-bdb5-63e4c956a4de', 'df8f20f5-6e92-4ac4-bdd2-05863ac4905f', '6d3a5ad0-c473-4d61-9101-9c7582c27390', 'a9ca3845-322a-44b9-bb41-74f7ea3d04f7', '4be97761-0b55-45fd-ba63-8ef18d95b9f2', '64d5aaad-612c-45e4-8c2c-8d390ad3ffdd', 'e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761', '55f254c4-5a5d-440f-958c-5fd96778e473', '04a082fe-52f7-4ac6-a12b-63791c63be86', 'ca9b1416-779b-4bc5-ae29-5117ebb9bc1a', '954d5d18-f5f4-41ee-a496-48e087a4b527', '28809bb1-c80b-4696-9980-5f00f47130bb', '31d51b9f-24c2-407d-92f6-bfa0a20cfef8', '3177f360-f74b-456a-9c1b-681726056f53', '81470f34-f44d-4111-b9a8-fc43c119e1dd', 'e23923e3-0ade-47cf-aa89-03f9a991b3f7', 'b55beff3-0092-4844-958f-ed6f6ef8b108', 'd141340f-d099-4b67-88b0-348423856ab2', 'f58ad372-72ca-472a-aab5-8b86e9d2f1e6', '03fa4ca9-532b-43b0-bd53-de11eea0a016', '2db7d87e-43a6-451c-9080-385c174466ee', '9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1', '8004bc6e-552e-4ff4-87f0-242b54bbfb5d', '336e562f-9c8e-4021-953e-5756518b10b0', '3496e6be-51c4-4b7a-9789-b13bae7f2cda', 'ad8b8cdd-7eee-48c2-8c33-7b83fde75038', '1440acfc-c5d6-4a44-b0a8-654c4f16a7d1', '45904912-7759-4b89-83ba-2a95c86ca5fd', 'ecaff113-395f-46a3-b8a5-a3ce5cb003a5', '406660af-f92d-476c-ab5f-e3168c58847d', '77b7addf-0db2-4091-a32b-1272c6ac49b5', 'b20ed1f0-7f46-40ac-882f-36a610d96a98', 'dd5a38a7-babd-4c6b-b3a5-af13dd79865d', 'ec4cc5da-964e-43e8-9531-6581ec387b4d', '3f4770f9-9c1b-48b7-8d14-3089a02098e4', 'e8c65e5a-d52c-481c-a6b2-680dae9a4593', 'ced2222f-152a-4951-8da3-65259a9e32af', 'f0060547-03fb-4d1a-ad8e-69519760b908', '3172accd-a4e8-4297-999e-158d19f8d74b', '63a56402-3dcf-44d4-b33d-a56ff531a12c', '94eb8a38-d1bf-4747-a73b-c4d0ea236bc3'} {{(pid=70614) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1114.989155] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1115.015029] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.015029] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.015029] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.015029] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.015029] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.015029] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1115.015029] env[70614]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=70614) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1115.015029] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1115.092551] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.092763] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.092763] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.093021] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.094125] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.094405] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1115.094478] env[70614]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=70614) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1115.094554] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1115.094619] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1115.094700] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/50 resources of Type:Security Group Rules [ 1115.094790] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4e54f39e-349d-49ad-bb07-348488d846f0 with Priority: HIGH for action security_group_rules [ 1115.094852] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 49dd754e-129e-49c8-9e52-09796cb64337 with Priority: HIGH for action security_group_rules [ 1115.094909] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7ea2558c-aa82-4694-8be9-307b8ca3e536 with Priority: HIGH for action security_group_rules [ 1115.094972] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e with Priority: HIGH for action security_group_rules [ 1115.095041] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b with Priority: HIGH for action security_group_rules [ 1115.095097] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e with Priority: HIGH for action security_group_rules [ 1115.095263] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: def9aa42-470d-498e-9034-6879fb1e6ebc with Priority: HIGH for action security_group_rules [ 1115.095263] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0a55332f-b291-4614-8b34-ee4cd0d39027 with Priority: HIGH for action security_group_rules [ 1115.095263] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62 with Priority: HIGH for action security_group_rules [ 1115.095413] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ca55d9c7-11be-476b-bdb5-63e4c956a4de with Priority: HIGH for action security_group_rules [ 1115.095413] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f with Priority: HIGH for action security_group_rules [ 1115.095474] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 with Priority: HIGH for action security_group_rules [ 1115.095501] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a9ca3845-322a-44b9-bb41-74f7ea3d04f7 with Priority: HIGH for action security_group_rules [ 1115.095564] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4be97761-0b55-45fd-ba63-8ef18d95b9f2 with Priority: HIGH for action security_group_rules [ 1115.095609] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 64d5aaad-612c-45e4-8c2c-8d390ad3ffdd with Priority: HIGH for action security_group_rules [ 1115.095660] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 with Priority: HIGH for action security_group_rules [ 1115.095715] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 55f254c4-5a5d-440f-958c-5fd96778e473 with Priority: HIGH for action security_group_rules [ 1115.095783] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 with Priority: HIGH for action security_group_rules [ 1115.095840] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ca9b1416-779b-4bc5-ae29-5117ebb9bc1a with Priority: HIGH for action security_group_rules [ 1115.095902] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 954d5d18-f5f4-41ee-a496-48e087a4b527 with Priority: HIGH for action security_group_rules [ 1115.096047] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.411057] env[70614]: INFO networking_nsxv3.common.synchronization [None req-ed31b130-18c3-4bac-a55c-9555aa568417 None None] Enqueued Resource ID: 914e8f13-0e22-416e-8bf1-16699e08f5ea with Priority: HIGHEST for action port [ 1115.411057] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 914e8f13-0e22-416e-8bf1-16699e08f5ea with Priority: HIGHEST for action port [ 1115.411057] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e54f39e-349d-49ad-bb07-348488d846f0 with Priority: HIGH for action security_group_rules [ 1115.411057] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ea2558c-aa82-4694-8be9-307b8ca3e536 with Priority: HIGH for action security_group_rules [ 1115.411057] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: def9aa42-470d-498e-9034-6879fb1e6ebc with Priority: HIGH for action security_group_rules [ 1115.411057] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64d5aaad-612c-45e4-8c2c-8d390ad3ffdd with Priority: HIGH for action security_group_rules [ 1115.411057] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 954d5d18-f5f4-41ee-a496-48e087a4b527 with Priority: HIGH for action security_group_rules [ 1115.411057] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca9b1416-779b-4bc5-ae29-5117ebb9bc1a with Priority: HIGH for action security_group_rules [ 1115.411057] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 with Priority: HIGH for action security_group_rules [ 1115.411561] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55f254c4-5a5d-440f-958c-5fd96778e473 with Priority: HIGH for action security_group_rules [ 1115.411676] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4be97761-0b55-45fd-ba63-8ef18d95b9f2 with Priority: HIGH for action security_group_rules [ 1115.411911] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 with Priority: HIGH for action security_group_rules [ 1115.411955] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9ca3845-322a-44b9-bb41-74f7ea3d04f7 with Priority: HIGH for action security_group_rules [ 1115.412072] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 with Priority: HIGH for action security_group_rules [ 1115.412200] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f with Priority: HIGH for action security_group_rules [ 1115.412331] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca55d9c7-11be-476b-bdb5-63e4c956a4de with Priority: HIGH for action security_group_rules [ 1115.412434] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62 with Priority: HIGH for action security_group_rules [ 1115.412561] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e with Priority: HIGH for action security_group_rules [ 1115.412679] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a55332f-b291-4614-8b34-ee4cd0d39027 with Priority: HIGH for action security_group_rules [ 1115.412803] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b with Priority: HIGH for action security_group_rules [ 1115.413187] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49dd754e-129e-49c8-9e52-09796cb64337 with Priority: HIGH for action security_group_rules [ 1115.413331] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e with Priority: HIGH for action security_group_rules [ 1115.417172] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-914e8f13-0e22-416e-8bf1-16699e08f5ea taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.418078] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-914e8f13-0e22-416e-8bf1-16699e08f5ea" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.418578] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-914e8f13-0e22-416e-8bf1-16699e08f5ea" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.418888] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-914e8f13-0e22-416e-8bf1-16699e08f5ea" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.418971] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('914e8f13-0e22-416e-8bf1-16699e08f5ea',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.419894] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e54f39e-349d-49ad-bb07-348488d846f0 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.420043] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.420119] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.420304] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.420382] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e54f39e-349d-49ad-bb07-348488d846f0',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.421172] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ea2558c-aa82-4694-8be9-307b8ca3e536 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.421296] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ea2558c-aa82-4694-8be9-307b8ca3e536" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.421364] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ea2558c-aa82-4694-8be9-307b8ca3e536" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.421515] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ea2558c-aa82-4694-8be9-307b8ca3e536" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.421586] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ea2558c-aa82-4694-8be9-307b8ca3e536',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.424418] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-def9aa42-470d-498e-9034-6879fb1e6ebc taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.424532] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.424600] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.424761] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.424836] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('def9aa42-470d-498e-9034-6879fb1e6ebc',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.425849] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64d5aaad-612c-45e4-8c2c-8d390ad3ffdd taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.425849] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64d5aaad-612c-45e4-8c2c-8d390ad3ffdd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.425957] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64d5aaad-612c-45e4-8c2c-8d390ad3ffdd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.426055] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64d5aaad-612c-45e4-8c2c-8d390ad3ffdd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.426130] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64d5aaad-612c-45e4-8c2c-8d390ad3ffdd',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.426975] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-954d5d18-f5f4-41ee-a496-48e087a4b527 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.427108] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-954d5d18-f5f4-41ee-a496-48e087a4b527" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.427199] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-954d5d18-f5f4-41ee-a496-48e087a4b527" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.427437] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-954d5d18-f5f4-41ee-a496-48e087a4b527" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.427486] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('954d5d18-f5f4-41ee-a496-48e087a4b527',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.428177] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.428282] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.428363] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.428538] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.428613] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca9b1416-779b-4bc5-ae29-5117ebb9bc1a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.429323] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-04a082fe-52f7-4ac6-a12b-63791c63be86 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.429446] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.429496] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.429660] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.429732] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('04a082fe-52f7-4ac6-a12b-63791c63be86',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.430545] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55f254c4-5a5d-440f-958c-5fd96778e473 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.430654] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55f254c4-5a5d-440f-958c-5fd96778e473" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.430728] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55f254c4-5a5d-440f-958c-5fd96778e473" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.430869] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55f254c4-5a5d-440f-958c-5fd96778e473" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.431124] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55f254c4-5a5d-440f-958c-5fd96778e473',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.431615] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4be97761-0b55-45fd-ba63-8ef18d95b9f2 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.431721] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.431786] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.431934] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.432012] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4be97761-0b55-45fd-ba63-8ef18d95b9f2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.432679] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.432821] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.432852] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.432988] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.433075] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.433815] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9ca3845-322a-44b9-bb41-74f7ea3d04f7 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.433928] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9ca3845-322a-44b9-bb41-74f7ea3d04f7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.434008] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9ca3845-322a-44b9-bb41-74f7ea3d04f7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.434197] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9ca3845-322a-44b9-bb41-74f7ea3d04f7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.434304] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9ca3845-322a-44b9-bb41-74f7ea3d04f7',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.435795] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d3a5ad0-c473-4d61-9101-9c7582c27390 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.435904] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.435974] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.436259] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.436458] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d3a5ad0-c473-4d61-9101-9c7582c27390',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.437031] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df8f20f5-6e92-4ac4-bdd2-05863ac4905f taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.437167] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.437203] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.437363] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.437397] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df8f20f5-6e92-4ac4-bdd2-05863ac4905f',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.438079] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca55d9c7-11be-476b-bdb5-63e4c956a4de taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.438207] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca55d9c7-11be-476b-bdb5-63e4c956a4de" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.438252] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca55d9c7-11be-476b-bdb5-63e4c956a4de" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.438403] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca55d9c7-11be-476b-bdb5-63e4c956a4de" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.438474] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca55d9c7-11be-476b-bdb5-63e4c956a4de',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.439226] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.439355] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.439399] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.439550] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.439621] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.441439] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3060abf5-a0d6-4fce-88da-15f03f632b6e taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.441510] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.441569] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.441724] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.441796] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3060abf5-a0d6-4fce-88da-15f03f632b6e',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.442515] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a55332f-b291-4614-8b34-ee4cd0d39027 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.442611] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.443286] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.443286] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.443286] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a55332f-b291-4614-8b34-ee4cd0d39027',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.443561] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.443680] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.443770] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.443929] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.444016] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.447935] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49dd754e-129e-49c8-9e52-09796cb64337 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.448096] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.448158] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.448284] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.448360] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49dd754e-129e-49c8-9e52-09796cb64337',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.449446] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.449557] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.449624] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.449842] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.449842] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.476329] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.476588] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.476588] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.476743] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.478475] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.478591] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.498465] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.498673] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64d5aaad-612c-45e4-8c2c-8d390ad3ffdd is going to be deleted. [ 1115.500362] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.500677] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.526338] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.526484] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 954d5d18-f5f4-41ee-a496-48e087a4b527 is going to be deleted. [ 1115.560478] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.560478] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.560478] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.560478] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.560478] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.560478] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64d5aaad-612c-45e4-8c2c-8d390ad3ffdd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.573079] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.573079] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.573225] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.573365] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.573456] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.573580] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-954d5d18-f5f4-41ee-a496-48e087a4b527" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.619062] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 in Status: SUCCESS [ 1115.619308] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 deletion is rescheduled due to dependency. [ 1115.619411] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.952881] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca55d9c7-11be-476b-bdb5-63e4c956a4de taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.952881] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca55d9c7-11be-476b-bdb5-63e4c956a4de" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.952881] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca55d9c7-11be-476b-bdb5-63e4c956a4de" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.952881] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca55d9c7-11be-476b-bdb5-63e4c956a4de" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.952881] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.953495] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.953495] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.953495] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.953495] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.953495] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca55d9c7-11be-476b-bdb5-63e4c956a4de" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.953495] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ca55d9c7-11be-476b-bdb5-63e4c956a4de',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.956357] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e54f39e-349d-49ad-bb07-348488d846f0 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.956515] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.956559] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.956805] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.956885] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.956979] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.957060] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.957206] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.957284] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.957368] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.957456] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4e54f39e-349d-49ad-bb07-348488d846f0',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.965410] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 914e8f13-0e22-416e-8bf1-16699e08f5ea [ 1115.965608] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.965721] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.965787] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.965972] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.966079] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.966173] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:914e8f13-0e22-416e-8bf1-16699e08f5ea already deleted. [ 1115.966257] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-914e8f13-0e22-416e-8bf1-16699e08f5ea" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.969751] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-def9aa42-470d-498e-9034-6879fb1e6ebc taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.969859] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.969898] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.970113] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.970309] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.970445] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.970528] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.970725] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.971095] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.971095] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.971095] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('def9aa42-470d-498e-9034-6879fb1e6ebc',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.982130] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.982299] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.982350] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.982552] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.982724] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.982824] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.982891] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.983063] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.983152] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.983238] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.983454] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.995401] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.995598] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.995655] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.995858] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.016237] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.016392] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.017301] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.017451] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.104147] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.104328] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.105682] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.105682] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.106308] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.106434] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.107365] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.107482] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.108437] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.108542] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.109402] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.109536] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.110564] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.110564] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.111378] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.111492] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.112139] env[70614]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1116.112653] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.112805] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.113698] env[70614]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1116.114212] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.114320] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.115125] env[70614]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1116.115619] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.115799] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.116499] env[70614]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1116.117043] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.117295] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4be97761-0b55-45fd-ba63-8ef18d95b9f2 is going to be deleted. [ 1116.118296] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.118495] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.139447] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.139716] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ea2558c-aa82-4694-8be9-307b8ca3e536 is going to be deleted. [ 1116.140984] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.141479] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.189284] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.189422] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a55332f-b291-4614-8b34-ee4cd0d39027 is going to be deleted. [ 1116.190818] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.191107] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.215497] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.215497] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.223800] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.223906] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55f254c4-5a5d-440f-958c-5fd96778e473 is going to be deleted. [ 1116.225730] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.225730] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.245406] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.245406] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62 is going to be deleted. [ 1116.246765] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.246765] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.247771] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.247911] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.273326] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.273326] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df8f20f5-6e92-4ac4-bdd2-05863ac4905f is going to be deleted. [ 1116.273326] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.273326] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.277755] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.277900] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.288060] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.288242] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.305358] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.305487] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b is going to be deleted. [ 1116.306748] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.307021] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.342455] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.342702] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.415752] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.415939] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca9b1416-779b-4bc5-ae29-5117ebb9bc1a is going to be deleted. [ 1116.416874] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.417131] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.421143] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.421283] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.442744] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.442850] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 04a082fe-52f7-4ac6-a12b-63791c63be86 is going to be deleted. [ 1116.443809] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.444178] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.457101] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ca55d9c7-11be-476b-bdb5-63e4c956a4de',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.462379] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4e54f39e-349d-49ad-bb07-348488d846f0',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.477753] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('def9aa42-470d-498e-9034-6879fb1e6ebc',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.490859] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.493360] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.493360] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49dd754e-129e-49c8-9e52-09796cb64337 is going to be deleted. [ 1116.495192] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.495446] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.527104] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.527254] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.543094] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.543094] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761 is going to be deleted. [ 1116.544106] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.544342] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.545906] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.546024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.590900] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.591107] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 is going to be deleted. [ 1116.592105] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.592374] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.608772] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.608906] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.643508] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.643508] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3060abf5-a0d6-4fce-88da-15f03f632b6e is going to be deleted. [ 1116.644448] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.644680] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.646146] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.646276] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.703771] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.703946] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9ca3845-322a-44b9-bb41-74f7ea3d04f7 is going to be deleted. [ 1116.704847] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.705101] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.705304] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.705304] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4be97761-0b55-45fd-ba63-8ef18d95b9f2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.705474] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.705629] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.705779] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.705825] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ea2558c-aa82-4694-8be9-307b8ca3e536" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.706436] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.706593] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.706707] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.706856] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55f254c4-5a5d-440f-958c-5fd96778e473" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.706995] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.707160] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.707238] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.707349] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a55332f-b291-4614-8b34-ee4cd0d39027" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.707349] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.707349] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.707349] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.707349] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f4bfb77-d6eb-4e5c-9174-aa3dda9dbe62" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.707349] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.708150] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.708150] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.708277] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df8f20f5-6e92-4ac4-bdd2-05863ac4905f" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.708382] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.708535] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.708608] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.708718] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-abc0ea82-a0b2-4356-b33a-3ac9b9c5f62b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.708838] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.708975] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.709070] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.709226] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca9b1416-779b-4bc5-ae29-5117ebb9bc1a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.709382] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.709552] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.709645] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.709795] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-04a082fe-52f7-4ac6-a12b-63791c63be86" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.709961] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.710149] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.710226] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.710359] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49dd754e-129e-49c8-9e52-09796cb64337" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.712717] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.712860] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.712903] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.713058] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.713141] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.713271] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e0c3322c-1ddf-4c4f-bdaf-9f9239ebe761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.738378] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.738521] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.738590] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.738824] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.738952] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.739024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.788329] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.788523] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.788578] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.788790] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.789189] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.789494] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3060abf5-a0d6-4fce-88da-15f03f632b6e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.860536] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.860744] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.860785] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.861076] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.861305] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.861391] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9ca3845-322a-44b9-bb41-74f7ea3d04f7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.960628] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ca55d9c7-11be-476b-bdb5-63e4c956a4de: rpc.has_security_group_logging(os_id): False [ 1116.966077] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4e54f39e-349d-49ad-bb07-348488d846f0: rpc.has_security_group_logging(os_id): False [ 1116.981805] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for def9aa42-470d-498e-9034-6879fb1e6ebc: rpc.has_security_group_logging(os_id): False [ 1116.992212] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.992430] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.992430] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.992650] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.996271] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.996721] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.997059] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e: rpc.has_security_group_logging(os_id): False [ 1117.001478] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.001656] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.014583] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.014707] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.017447] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.017746] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.017886] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.017979] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.018140] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.018240] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.018337] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e54f39e-349d-49ad-bb07-348488d846f0 is going to be updated. [ 1117.019454] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.019650] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.059913] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.060349] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.060491] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.060603] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.060774] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.060864] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.060969] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca55d9c7-11be-476b-bdb5-63e4c956a4de is going to be updated. [ 1117.062340] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.062571] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.082249] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.082737] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.082890] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.083011] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.083314] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.083720] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.083720] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e is going to be updated. [ 1117.085130] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.085397] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.115838] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.116316] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.116485] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.116590] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.117253] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.117253] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.117253] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: def9aa42-470d-498e-9034-6879fb1e6ebc is going to be updated. [ 1117.119835] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.119835] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.119998] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.120107] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.120259] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.142763] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.142946] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.142984] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.143218] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.143382] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.145859] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e54f39e-349d-49ad-bb07-348488d846f0 in Status: IN_PROGRESS for 2s [ 1117.163259] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca55d9c7-11be-476b-bdb5-63e4c956a4de in Status: IN_PROGRESS for 2s [ 1117.189218] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.189378] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.189452] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.189678] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.189839] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.251365] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e in Status: IN_PROGRESS for 2s [ 1117.252980] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.252980] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.252980] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.252980] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.253251] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.282732] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: def9aa42-470d-498e-9034-6879fb1e6ebc in Status: IN_PROGRESS for 2s [ 1117.475187] env[70614]: INFO networking_nsxv3.common.synchronization [req-cb9713c9-729a-4239-b54d-ea15f99c71df req-a599ad50-0ea9-46c2-ac20-49e0d836417d tempest-ServerDiskConfigTestJSON-2045015546 tempest-ServerDiskConfigTestJSON-2045015546-project-member] Enqueued Resource ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 with Priority: HIGHEST for action security_group_members [ 1117.475774] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 with Priority: HIGHEST for action security_group_members [ 1117.476663] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.476857] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.476986] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.477267] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.477500] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.477668] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.477804] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.478019] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.478180] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.478875] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94eb8a38-d1bf-4747-a73b-c4d0ea236bc3',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.523189] env[70614]: INFO networking_nsxv3.common.synchronization [req-c6bd0e03-fa2d-4d04-afec-986868c92880 req-5be4fb7f-c03b-4299-9c03-a167f76db922 tempest-AttachInterfacesTestJSON-1919943007 tempest-AttachInterfacesTestJSON-1919943007-project-member] Enqueued Resource ID: ca55d9c7-11be-476b-bdb5-63e4c956a4de with Priority: HIGHEST for action security_group_members [ 1117.523796] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca55d9c7-11be-476b-bdb5-63e4c956a4de with Priority: HIGHEST for action security_group_members [ 1117.526698] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca55d9c7-11be-476b-bdb5-63e4c956a4de taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.526836] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca55d9c7-11be-476b-bdb5-63e4c956a4de" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.526957] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca55d9c7-11be-476b-bdb5-63e4c956a4de" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.527148] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca55d9c7-11be-476b-bdb5-63e4c956a4de" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.527319] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.527444] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.527484] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.527926] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.527926] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.527926] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca55d9c7-11be-476b-bdb5-63e4c956a4de',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.840693] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-498 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.840693] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-498" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.840888] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-498" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.841207] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-498" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.841510] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.841724] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.842205] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.842205] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.842321] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.842578] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1117.842788] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1117.842878] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1117.843034] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1117.843301] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1117.843301] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1117.843477] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1117.864174] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1117.864448] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1117.864559] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1117.864704] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-498" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.865092] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-eaa7b106-c211-412e-9a5b-ed68bb8820b4 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.865305] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-eaa7b106-c211-412e-9a5b-ed68bb8820b4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.865432] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-eaa7b106-c211-412e-9a5b-ed68bb8820b4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.865759] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-eaa7b106-c211-412e-9a5b-ed68bb8820b4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.865900] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eaa7b106-c211-412e-9a5b-ed68bb8820b4',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.980380] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.980730] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.980730] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.981055] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.003669] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.003938] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.004072] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.004191] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.004360] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.004440] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.004527] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 is going to be updated. [ 1118.031424] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.031424] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.031424] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.031424] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.031424] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.031725] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.031725] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.031816] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.032105] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.032105] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.032187] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca55d9c7-11be-476b-bdb5-63e4c956a4de is going to be updated. [ 1118.034169] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.034298] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.034353] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.034553] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.034716] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.045782] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 in Status: IN_PROGRESS for 2s [ 1118.066272] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.066272] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.066272] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.066272] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.066272] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.074805] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca55d9c7-11be-476b-bdb5-63e4c956a4de in Status: IN_PROGRESS for 2s [ 1118.368957] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.369324] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.369472] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.369792] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.370060] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.370261] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port eaa7b106-c211-412e-9a5b-ed68bb8820b4 not found, creating... [ 1118.370560] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.370724] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.370846] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.371227] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.371645] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.372047] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.372228] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.372368] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.372664] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.372815] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.372993] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: eaa7b106-c211-412e-9a5b-ed68bb8820b4 is going to be created. [ 1118.398464] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.398691] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.398737] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.399914] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.399914] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.399914] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-eaa7b106-c211-412e-9a5b-ed68bb8820b4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.107024] env[70614]: INFO networking_nsxv3.common.synchronization [req-cb9713c9-729a-4239-b54d-ea15f99c71df req-a7186ed8-e1f6-405c-be0e-3203bb8f23e6 service nova] Enqueued Resource ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 with Priority: HIGHEST for action security_group_rules [ 1119.107024] env[70614]: INFO networking_nsxv3.common.synchronization [req-cb9713c9-729a-4239-b54d-ea15f99c71df req-a7186ed8-e1f6-405c-be0e-3203bb8f23e6 service nova] Enqueued Resource ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 with Priority: HIGHEST for action security_group_members [ 1119.107024] env[70614]: INFO networking_nsxv3.common.synchronization [req-cb9713c9-729a-4239-b54d-ea15f99c71df req-a7186ed8-e1f6-405c-be0e-3203bb8f23e6 service nova] Enqueued Resource ID: eaa7b106-c211-412e-9a5b-ed68bb8820b4 with Priority: HIGHEST for action port [ 1119.107024] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 with Priority: HIGHEST for action security_group_rules [ 1119.107024] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 with Priority: HIGHEST for action security_group_members [ 1119.107024] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eaa7b106-c211-412e-9a5b-ed68bb8820b4 with Priority: HIGHEST for action port [ 1119.107024] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.107024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.107024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.107024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.107827] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('94eb8a38-d1bf-4747-a73b-c4d0ea236bc3',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.108840] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.109104] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.109555] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-eaa7b106-c211-412e-9a5b-ed68bb8820b4 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.111219] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eaa7b106-c211-412e-9a5b-ed68bb8820b4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.111219] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eaa7b106-c211-412e-9a5b-ed68bb8820b4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.111219] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eaa7b106-c211-412e-9a5b-ed68bb8820b4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.111219] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eaa7b106-c211-412e-9a5b-ed68bb8820b4',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.160863] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e54f39e-349d-49ad-bb07-348488d846f0 in Status: SUCCESS [ 1119.161127] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.174201] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca55d9c7-11be-476b-bdb5-63e4c956a4de in Status: SUCCESS [ 1119.174201] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca55d9c7-11be-476b-bdb5-63e4c956a4de" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.264842] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e in Status: SUCCESS [ 1119.265142] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.296103] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: def9aa42-470d-498e-9034-6879fb1e6ebc in Status: SUCCESS [ 1119.296760] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.612190] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.612403] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.613071] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port eaa7b106-c211-412e-9a5b-ed68bb8820b4 with status ACTIVE [ 1119.613071] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.613071] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.613071] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.613303] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.613303] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.613440] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.613539] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.613602] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.613760] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.613839] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.614032] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.614127] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.614201] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.614353] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.614404] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.614480] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: eaa7b106-c211-412e-9a5b-ed68bb8820b4 is going to be updated. [ 1119.638439] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.638439] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.638439] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.638645] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.638774] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.638927] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eaa7b106-c211-412e-9a5b-ed68bb8820b4" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.058694] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 in Status: SUCCESS [ 1120.058694] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 deletion is rescheduled due to dependency. [ 1120.058694] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.058694] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.058694] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.058694] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.058694] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.058694] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.058694] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.058694] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.058694] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94eb8a38-d1bf-4747-a73b-c4d0ea236bc3',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.085040] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca55d9c7-11be-476b-bdb5-63e4c956a4de in Status: SUCCESS [ 1120.085244] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca55d9c7-11be-476b-bdb5-63e4c956a4de deletion is rescheduled due to dependency. [ 1120.085357] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca55d9c7-11be-476b-bdb5-63e4c956a4de" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.565030] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('94eb8a38-d1bf-4747-a73b-c4d0ea236bc3',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.067380] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('94eb8a38-d1bf-4747-a73b-c4d0ea236bc3',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.570042] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.570398] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.570398] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.570398] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.570398] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.570398] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 is going to be updated. [ 1121.604868] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.605050] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.605222] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.605454] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.605600] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.615069] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 in Status: IN_PROGRESS for 2s [ 1122.959733] env[70614]: INFO networking_nsxv3.common.synchronization [None req-4c96c20b-6cdc-4832-83de-e9477090ee1b tempest-ServerRescueNegativeTestJSON-1616269448 tempest-ServerRescueNegativeTestJSON-1616269448-project-member] Enqueued Resource ID: 77761344-a891-4e31-9381-80451d04a355 with Priority: HIGHEST for action security_group_rules [ 1122.960281] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77761344-a891-4e31-9381-80451d04a355 with Priority: HIGHEST for action security_group_rules [ 1122.960581] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-77761344-a891-4e31-9381-80451d04a355 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.960956] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-77761344-a891-4e31-9381-80451d04a355" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.961126] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-77761344-a891-4e31-9381-80451d04a355" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.961436] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-77761344-a891-4e31-9381-80451d04a355" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.961554] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('77761344-a891-4e31-9381-80451d04a355',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.036877] env[70614]: INFO networking_nsxv3.common.synchronization [None req-70cc6a84-b82a-4413-8e50-9c8a2632c3a2 tempest-ServerRescueNegativeTestJSON-1616269448 tempest-ServerRescueNegativeTestJSON-1616269448-project-member] Enqueued Resource ID: 77761344-a891-4e31-9381-80451d04a355 with Priority: HIGHEST for action security_group_rules [ 1123.036877] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77761344-a891-4e31-9381-80451d04a355 with Priority: HIGHEST for action security_group_rules [ 1123.036877] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-77761344-a891-4e31-9381-80451d04a355 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.036877] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-77761344-a891-4e31-9381-80451d04a355" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.488065] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.488065] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.488065] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.488065] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.488065] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.488065] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 77761344-a891-4e31-9381-80451d04a355 already deleted. [ 1123.488065] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-77761344-a891-4e31-9381-80451d04a355" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.488065] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-77761344-a891-4e31-9381-80451d04a355" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.488065] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-77761344-a891-4e31-9381-80451d04a355" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.488065] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('77761344-a891-4e31-9381-80451d04a355',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.625528] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 in Status: SUCCESS [ 1123.625764] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.625936] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.626211] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.626449] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.626794] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.626794] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.626864] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.626965] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.627592] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.627592] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('94eb8a38-d1bf-4747-a73b-c4d0ea236bc3',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.631796] env[70614]: INFO networking_nsxv3.common.synchronization [req-4179fcaa-de0f-47bd-ae2c-4875e8861cc8 req-abd24db3-0d02-439a-b487-569724eb3aba tempest-ServersTestJSON-1535400473 tempest-ServersTestJSON-1535400473-project-member] Enqueued Resource ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 with Priority: HIGHEST for action security_group_members [ 1123.632862] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 with Priority: HIGHEST for action security_group_members [ 1123.636103] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-76d591d6-9294-4288-b5c9-f6b7e2b45562 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.636238] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.636308] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.636540] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.636693] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.636794] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.636857] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.637010] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.637869] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.637869] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.017242] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.017545] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.017545] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.017673] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.017760] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.017857] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 77761344-a891-4e31-9381-80451d04a355 already deleted. [ 1124.017944] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-77761344-a891-4e31-9381-80451d04a355" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.051573] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-146 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.051792] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-146" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.051926] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-146" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.052309] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-146" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.052870] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.053429] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.053429] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.053695] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.053910] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.054211] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1124.054429] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1124.054601] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1124.054762] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1124.054933] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1124.055105] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1124.055303] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1124.086960] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1124.088170] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1124.088170] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1124.088170] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-146" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.088170] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-b459edb6-17e4-4c22-98c5-8db5fe36ea37 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.088504] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-b459edb6-17e4-4c22-98c5-8db5fe36ea37" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.088701] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-b459edb6-17e4-4c22-98c5-8db5fe36ea37" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.089186] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-b459edb6-17e4-4c22-98c5-8db5fe36ea37" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.089390] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b459edb6-17e4-4c22-98c5-8db5fe36ea37',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.135655] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.135655] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.135655] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.135655] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.135655] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.135655] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.135655] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.135655] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.136149] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.136149] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.136213] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.136378] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.136434] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.136664] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.136881] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.140033] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.140033] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.140033] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.140033] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.140033] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.140033] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('94eb8a38-d1bf-4747-a73b-c4d0ea236bc3',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.140769] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.140769] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.140907] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.141113] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.141257] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.141556] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.141727] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.141837] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.142103] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.142241] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.142391] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 already deleted. [ 1124.142525] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.593969] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.593969] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.593969] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.593969] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.593969] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.593969] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port b459edb6-17e4-4c22-98c5-8db5fe36ea37 not found, creating... [ 1124.594353] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.594353] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.594442] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.594861] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.595042] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.595338] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.595557] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.595714] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.595968] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.596169] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.596364] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: b459edb6-17e4-4c22-98c5-8db5fe36ea37 is going to be created. [ 1124.617117] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.617346] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.617475] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.617752] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.617986] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.618309] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-b459edb6-17e4-4c22-98c5-8db5fe36ea37" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.643996] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3: rpc.has_security_group_logging(os_id): False [ 1124.662861] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.663071] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.663150] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.663373] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.663480] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.663741] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.663909] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.664040] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.664206] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.664288] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.664492] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.664590] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.664655] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.664793] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.664868] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.665080] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.665179] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.665245] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.665365] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.665437] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.665680] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 is going to be updated. [ 1124.757161] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.757161] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.757161] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.757161] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.757161] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.781218] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 in Status: IN_PROGRESS for 2s [ 1125.329685] env[70614]: INFO networking_nsxv3.common.synchronization [req-4179fcaa-de0f-47bd-ae2c-4875e8861cc8 req-efab0aff-4e44-4f6c-9f45-4e089f69c160 service nova] Enqueued Resource ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 with Priority: HIGHEST for action security_group_rules [ 1125.329685] env[70614]: INFO networking_nsxv3.common.synchronization [req-4179fcaa-de0f-47bd-ae2c-4875e8861cc8 req-efab0aff-4e44-4f6c-9f45-4e089f69c160 service nova] Enqueued Resource ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 with Priority: HIGHEST for action security_group_members [ 1125.329685] env[70614]: INFO networking_nsxv3.common.synchronization [req-4179fcaa-de0f-47bd-ae2c-4875e8861cc8 req-efab0aff-4e44-4f6c-9f45-4e089f69c160 service nova] Enqueued Resource ID: b459edb6-17e4-4c22-98c5-8db5fe36ea37 with Priority: HIGHEST for action port [ 1125.333620] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 with Priority: HIGHEST for action security_group_rules [ 1125.333620] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 with Priority: HIGHEST for action security_group_members [ 1125.333620] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b459edb6-17e4-4c22-98c5-8db5fe36ea37 with Priority: HIGHEST for action port [ 1125.333620] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-76d591d6-9294-4288-b5c9-f6b7e2b45562 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.333620] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.333620] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.333620] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.333620] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.333620] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-76d591d6-9294-4288-b5c9-f6b7e2b45562 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.333620] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.333620] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.333620] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.333620] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.333620] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.333620] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.333620] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.333620] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.333620] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.335508] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-b459edb6-17e4-4c22-98c5-8db5fe36ea37 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.335508] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b459edb6-17e4-4c22-98c5-8db5fe36ea37" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.335508] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b459edb6-17e4-4c22-98c5-8db5fe36ea37" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.335508] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b459edb6-17e4-4c22-98c5-8db5fe36ea37" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.335508] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b459edb6-17e4-4c22-98c5-8db5fe36ea37',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.758736] env[70614]: INFO networking_nsxv3.common.synchronization [None req-35d617ff-739f-46ab-ae86-753c45d5707a tempest-AttachInterfacesTestJSON-1919943007 tempest-AttachInterfacesTestJSON-1919943007-project-member] Enqueued Resource ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 with Priority: HIGHEST for action security_group_members [ 1125.759268] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 with Priority: HIGHEST for action security_group_members [ 1125.759574] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d3a5ad0-c473-4d61-9101-9c7582c27390 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.759758] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.759758] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.759959] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.760476] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.760476] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.760476] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.760476] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.760652] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.760652] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d3a5ad0-c473-4d61-9101-9c7582c27390',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.837027] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-76d591d6-9294-4288-b5c9-f6b7e2b45562 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.837177] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.837458] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.838775] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b459edb6-17e4-4c22-98c5-8db5fe36ea37 with status ACTIVE [ 1125.839763] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.839763] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.839763] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.839763] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.839942] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.840071] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.840184] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.840247] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.840411] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.840491] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.840732] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.840811] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.840811] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.840957] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.841065] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.841216] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b459edb6-17e4-4c22-98c5-8db5fe36ea37 is going to be updated. [ 1125.862934] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.863089] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.863231] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.863368] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.863521] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.863680] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b459edb6-17e4-4c22-98c5-8db5fe36ea37" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.262549] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.262751] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.262908] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.263030] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.263126] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.263322] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.263461] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.263517] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.263620] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.263696] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.263784] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d3a5ad0-c473-4d61-9101-9c7582c27390 is going to be deleted. [ 1126.298862] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.298862] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.298862] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.298862] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.298862] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.298862] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d3a5ad0-c473-4d61-9101-9c7582c27390" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.343495] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.796965] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 in Status: SUCCESS [ 1126.797094] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.846510] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.846701] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.847705] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.847705] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.847857] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.847886] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 is going to be created. [ 1126.874366] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.874366] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.874655] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.874655] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.874791] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.885569] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 in Status: UNINITIALIZED for 2s [ 1128.896850] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 in Status: SUCCESS [ 1128.897207] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.897493] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.897493] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.897681] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.897798] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.897862] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.898021] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.898124] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.899030] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.899030] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.401219] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-76d591d6-9294-4288-b5c9-f6b7e2b45562 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.401383] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.401491] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.401679] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.401852] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.401958] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.402050] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.402185] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.402280] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.402399] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.402521] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-76d591d6-9294-4288-b5c9-f6b7e2b45562 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.402635] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.402683] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.402888] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.402986] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.403118] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.403118] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.403325] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.403325] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.403418] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.403458] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.905719] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 76d591d6-9294-4288-b5c9-f6b7e2b45562: rpc.has_security_group_logging(os_id): False [ 1129.925749] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.925961] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.926082] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.926385] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.926510] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.926753] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.926904] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.927010] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.927197] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.927315] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.927597] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.927771] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.927771] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.928623] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.928623] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.928623] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.928623] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.928623] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.929111] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.929111] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.929111] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 is going to be created. [ 1129.993114] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.993247] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.993318] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.993559] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.993698] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.006181] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 in Status: IN_PROGRESS for 2s [ 1130.559256] env[70614]: INFO networking_nsxv3.common.synchronization [req-8180b1e9-45e4-484f-aedc-4210f29d5bcf req-17325d5c-b7f0-497c-84ad-d0eada7e63bf tempest-ServerRescueNegativeTestJSON-1616269448 tempest-ServerRescueNegativeTestJSON-1616269448-project-member] Enqueued Resource ID: 77761344-a891-4e31-9381-80451d04a355 with Priority: HIGHEST for action security_group_members [ 1130.559767] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77761344-a891-4e31-9381-80451d04a355 with Priority: HIGHEST for action security_group_members [ 1130.560630] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-77761344-a891-4e31-9381-80451d04a355 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.560630] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77761344-a891-4e31-9381-80451d04a355" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.560630] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77761344-a891-4e31-9381-80451d04a355" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.560630] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77761344-a891-4e31-9381-80451d04a355" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.560872] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.560872] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.560872] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.561018] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.561098] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.561195] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77761344-a891-4e31-9381-80451d04a355',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.006517] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-225 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.006852] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-225" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.006852] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-225" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.007294] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-225" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.007370] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.007539] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.007662] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.007879] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.008105] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.008308] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1131.008429] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1131.008545] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1131.008659] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1131.008945] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1131.008945] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1131.009047] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1131.029047] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1131.029230] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1131.029371] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1131.029547] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-225" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.029861] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-c7eda4ab-b0a7-4d7f-8dbf-616ab793969d taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.030042] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-c7eda4ab-b0a7-4d7f-8dbf-616ab793969d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.030193] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-c7eda4ab-b0a7-4d7f-8dbf-616ab793969d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.030529] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-c7eda4ab-b0a7-4d7f-8dbf-616ab793969d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.030675] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c7eda4ab-b0a7-4d7f-8dbf-616ab793969d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.064034] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.064364] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.064364] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.064490] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.064603] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.064750] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.064857] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.064921] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.065087] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.065292] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.065292] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77761344-a891-4e31-9381-80451d04a355 already deleted. [ 1131.065396] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77761344-a891-4e31-9381-80451d04a355" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.535173] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.535522] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.535670] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.535979] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.536154] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.536322] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port c7eda4ab-b0a7-4d7f-8dbf-616ab793969d not found, creating... [ 1131.536596] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.536759] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.536883] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.537123] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.537268] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.537551] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.537714] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.537836] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.538302] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.538505] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.538658] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: c7eda4ab-b0a7-4d7f-8dbf-616ab793969d is going to be created. [ 1131.559741] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.559956] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.560161] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.560462] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.560698] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.560925] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-c7eda4ab-b0a7-4d7f-8dbf-616ab793969d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.018856] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 in Status: SUCCESS [ 1132.019179] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.377903] env[70614]: INFO networking_nsxv3.common.synchronization [req-8180b1e9-45e4-484f-aedc-4210f29d5bcf req-956bb3d2-36cd-4e51-bd8b-df4f1e755861 service nova] Enqueued Resource ID: 77761344-a891-4e31-9381-80451d04a355 with Priority: HIGHEST for action security_group_rules [ 1132.378173] env[70614]: INFO networking_nsxv3.common.synchronization [req-8180b1e9-45e4-484f-aedc-4210f29d5bcf req-956bb3d2-36cd-4e51-bd8b-df4f1e755861 service nova] Enqueued Resource ID: 77761344-a891-4e31-9381-80451d04a355 with Priority: HIGHEST for action security_group_members [ 1132.378362] env[70614]: INFO networking_nsxv3.common.synchronization [req-8180b1e9-45e4-484f-aedc-4210f29d5bcf req-956bb3d2-36cd-4e51-bd8b-df4f1e755861 service nova] Enqueued Resource ID: c7eda4ab-b0a7-4d7f-8dbf-616ab793969d with Priority: HIGHEST for action port [ 1132.378911] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77761344-a891-4e31-9381-80451d04a355 with Priority: HIGHEST for action security_group_rules [ 1132.379055] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77761344-a891-4e31-9381-80451d04a355 with Priority: HIGHEST for action security_group_members [ 1132.379247] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7eda4ab-b0a7-4d7f-8dbf-616ab793969d with Priority: HIGHEST for action port [ 1132.379537] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-77761344-a891-4e31-9381-80451d04a355 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.379675] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-77761344-a891-4e31-9381-80451d04a355" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.379752] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-77761344-a891-4e31-9381-80451d04a355" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.379967] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-77761344-a891-4e31-9381-80451d04a355" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.380159] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('77761344-a891-4e31-9381-80451d04a355',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.381105] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-77761344-a891-4e31-9381-80451d04a355 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.381260] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77761344-a891-4e31-9381-80451d04a355" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.381359] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77761344-a891-4e31-9381-80451d04a355" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.381454] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77761344-a891-4e31-9381-80451d04a355" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.381611] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.381718] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.381811] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.381896] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.381974] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.382192] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77761344-a891-4e31-9381-80451d04a355',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.384070] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-c7eda4ab-b0a7-4d7f-8dbf-616ab793969d taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.384230] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c7eda4ab-b0a7-4d7f-8dbf-616ab793969d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.384230] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c7eda4ab-b0a7-4d7f-8dbf-616ab793969d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.384475] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c7eda4ab-b0a7-4d7f-8dbf-616ab793969d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.384583] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c7eda4ab-b0a7-4d7f-8dbf-616ab793969d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.886934] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('77761344-a891-4e31-9381-80451d04a355',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.887966] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c7eda4ab-b0a7-4d7f-8dbf-616ab793969d with status ACTIVE [ 1132.888198] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.888329] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.888397] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.888600] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.888688] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.888856] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.888954] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.889029] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.889183] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.889260] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.889439] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.889532] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.889592] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.889732] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.889800] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.889879] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c7eda4ab-b0a7-4d7f-8dbf-616ab793969d is going to be updated. [ 1132.891238] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-77761344-a891-4e31-9381-80451d04a355 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.891360] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77761344-a891-4e31-9381-80451d04a355" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.915727] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.915911] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.915974] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.916178] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.916333] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.916796] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c7eda4ab-b0a7-4d7f-8dbf-616ab793969d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.393403] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('77761344-a891-4e31-9381-80451d04a355',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.896923] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.897148] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.897195] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.897404] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.897489] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.897587] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77761344-a891-4e31-9381-80451d04a355 is going to be created. [ 1133.925574] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.925574] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.925742] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.926293] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.926293] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.937931] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77761344-a891-4e31-9381-80451d04a355 in Status: UNINITIALIZED for 2s [ 1134.955027] env[70614]: INFO networking_nsxv3.common.synchronization [req-0715d988-df85-4b3d-b968-dfcbd31ddcbc req-f8cc5cee-2c7f-4aeb-ab1b-f56ab118cd72 tempest-ServersTestBootFromVolume-917450361 tempest-ServersTestBootFromVolume-917450361-project-member] Enqueued Resource ID: 45904912-7759-4b89-83ba-2a95c86ca5fd with Priority: HIGHEST for action security_group_members [ 1134.955837] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45904912-7759-4b89-83ba-2a95c86ca5fd with Priority: HIGHEST for action security_group_members [ 1134.955837] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-45904912-7759-4b89-83ba-2a95c86ca5fd taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.955837] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45904912-7759-4b89-83ba-2a95c86ca5fd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.955837] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45904912-7759-4b89-83ba-2a95c86ca5fd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.956022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45904912-7759-4b89-83ba-2a95c86ca5fd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.956105] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.956195] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.956242] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.956409] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.956497] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.956664] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45904912-7759-4b89-83ba-2a95c86ca5fd',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.403444] env[70614]: INFO networking_nsxv3.common.synchronization [req-66521d30-0231-4020-9f3b-e9efb5385e8f req-ae4cdb9b-84a5-4a83-9baa-2390fb69ea5a tempest-ServerActionsV293TestJSON-1550365301 tempest-ServerActionsV293TestJSON-1550365301-project-member] Enqueued Resource ID: ced2222f-152a-4951-8da3-65259a9e32af with Priority: HIGHEST for action security_group_members [ 1135.404456] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ced2222f-152a-4951-8da3-65259a9e32af with Priority: HIGHEST for action security_group_members [ 1135.404456] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-ced2222f-152a-4951-8da3-65259a9e32af taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.404456] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ced2222f-152a-4951-8da3-65259a9e32af" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.404456] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ced2222f-152a-4951-8da3-65259a9e32af" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.404722] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ced2222f-152a-4951-8da3-65259a9e32af" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.404816] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.404910] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.404971] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.406643] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.406643] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.406643] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ced2222f-152a-4951-8da3-65259a9e32af',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.458343] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.458602] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.458770] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.459081] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.487026] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.487314] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.487440] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.487506] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.487735] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.487818] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.487912] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45904912-7759-4b89-83ba-2a95c86ca5fd is going to be updated. [ 1135.523350] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.523541] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.523602] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.523845] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.524033] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.535990] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45904912-7759-4b89-83ba-2a95c86ca5fd in Status: IN_PROGRESS for 2s [ 1135.909342] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.909342] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.909342] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.910174] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.936867] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.937171] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.937302] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.937364] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.937796] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.937892] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.937979] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ced2222f-152a-4951-8da3-65259a9e32af is going to be updated. [ 1135.949371] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77761344-a891-4e31-9381-80451d04a355 in Status: SUCCESS [ 1135.949673] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77761344-a891-4e31-9381-80451d04a355" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.950032] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77761344-a891-4e31-9381-80451d04a355" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.950348] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77761344-a891-4e31-9381-80451d04a355" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.950558] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.950699] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.950766] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.951078] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.951182] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.951282] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77761344-a891-4e31-9381-80451d04a355" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.951387] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('77761344-a891-4e31-9381-80451d04a355',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.976608] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.977170] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.977170] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.977170] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.977384] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.986788] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ced2222f-152a-4951-8da3-65259a9e32af in Status: IN_PROGRESS for 2s [ 1136.059895] env[70614]: INFO networking_nsxv3.common.synchronization [req-3a211537-5efd-42c9-a273-27006548c84c req-6350e7e8-df98-4c48-96df-2834bcc7215b tempest-ListServerFiltersTestJSON-738554284 tempest-ListServerFiltersTestJSON-738554284-project-member] Enqueued Resource ID: 9e717c4b-1f67-4d20-9afd-677fdceb923a with Priority: HIGHEST for action security_group_members [ 1136.060611] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e717c4b-1f67-4d20-9afd-677fdceb923a with Priority: HIGHEST for action security_group_members [ 1136.060857] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e717c4b-1f67-4d20-9afd-677fdceb923a taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.061014] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.061229] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.061357] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.061507] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.061606] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.061660] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.061811] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.061909] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.061979] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e717c4b-1f67-4d20-9afd-677fdceb923a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.454032] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('77761344-a891-4e31-9381-80451d04a355',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.459277] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-435 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.459277] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-435" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.459277] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-435" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.459277] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-435" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.459277] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.459277] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.459277] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.462672] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.462672] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.462672] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1136.462892] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1136.462892] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1136.463058] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1136.463228] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1136.463303] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1136.464518] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1136.487203] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1136.487203] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1136.487203] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1136.487444] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-435" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.490764] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-400096f0-ddb2-4304-b5b2-eef1b2d40ba8 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.490764] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-400096f0-ddb2-4304-b5b2-eef1b2d40ba8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.490764] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-400096f0-ddb2-4304-b5b2-eef1b2d40ba8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.490764] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-400096f0-ddb2-4304-b5b2-eef1b2d40ba8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.490764] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('400096f0-ddb2-4304-b5b2-eef1b2d40ba8',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.565945] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.566197] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.566275] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.566635] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.566752] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.567059] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.567241] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.567362] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.567640] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.567736] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.567855] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e717c4b-1f67-4d20-9afd-677fdceb923a already deleted. [ 1136.568050] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.967238] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 77761344-a891-4e31-9381-80451d04a355: rpc.has_security_group_logging(os_id): False [ 1136.990329] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.990857] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.990857] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.990857] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.991085] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.991318] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.991451] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.991521] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.991715] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.991804] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.991934] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 77761344-a891-4e31-9381-80451d04a355 is going to be created. [ 1136.997190] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.997190] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.997190] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.997190] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.997190] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.997605] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 400096f0-ddb2-4304-b5b2-eef1b2d40ba8 not found, creating... [ 1136.997662] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.997955] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.998136] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.000039] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.000039] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.000039] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.000039] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.000039] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.000039] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.000039] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.000039] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 400096f0-ddb2-4304-b5b2-eef1b2d40ba8 is going to be created. [ 1137.026217] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.026544] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.030054] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.030054] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.030054] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.030054] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-400096f0-ddb2-4304-b5b2-eef1b2d40ba8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.081141] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.081380] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.081380] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.081649] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.081910] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.097565] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 77761344-a891-4e31-9381-80451d04a355 in Status: IN_PROGRESS for 2s [ 1137.546996] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45904912-7759-4b89-83ba-2a95c86ca5fd in Status: SUCCESS [ 1137.547056] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45904912-7759-4b89-83ba-2a95c86ca5fd deletion is rescheduled due to dependency. [ 1137.547184] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45904912-7759-4b89-83ba-2a95c86ca5fd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.743789] env[70614]: INFO networking_nsxv3.common.synchronization [req-3a211537-5efd-42c9-a273-27006548c84c req-d4032d42-9ce9-4b27-834f-7bb619f043ef service nova] Enqueued Resource ID: 9e717c4b-1f67-4d20-9afd-677fdceb923a with Priority: HIGHEST for action security_group_rules [ 1137.743789] env[70614]: INFO networking_nsxv3.common.synchronization [req-3a211537-5efd-42c9-a273-27006548c84c req-d4032d42-9ce9-4b27-834f-7bb619f043ef service nova] Enqueued Resource ID: 9e717c4b-1f67-4d20-9afd-677fdceb923a with Priority: HIGHEST for action security_group_members [ 1137.743789] env[70614]: INFO networking_nsxv3.common.synchronization [req-3a211537-5efd-42c9-a273-27006548c84c req-d4032d42-9ce9-4b27-834f-7bb619f043ef service nova] Enqueued Resource ID: 400096f0-ddb2-4304-b5b2-eef1b2d40ba8 with Priority: HIGHEST for action port [ 1137.748357] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e717c4b-1f67-4d20-9afd-677fdceb923a with Priority: HIGHEST for action security_group_rules [ 1137.751022] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e717c4b-1f67-4d20-9afd-677fdceb923a with Priority: HIGHEST for action security_group_members [ 1137.751022] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 400096f0-ddb2-4304-b5b2-eef1b2d40ba8 with Priority: HIGHEST for action port [ 1137.751022] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e717c4b-1f67-4d20-9afd-677fdceb923a taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.751022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.751022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.751022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.751022] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e717c4b-1f67-4d20-9afd-677fdceb923a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.752357] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e717c4b-1f67-4d20-9afd-677fdceb923a taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.752637] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.752818] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.753156] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.753419] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.754092] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.754737] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.755067] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.755275] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.755485] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e717c4b-1f67-4d20-9afd-677fdceb923a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.757393] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-400096f0-ddb2-4304-b5b2-eef1b2d40ba8 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.757663] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-400096f0-ddb2-4304-b5b2-eef1b2d40ba8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.757854] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-400096f0-ddb2-4304-b5b2-eef1b2d40ba8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.758170] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-400096f0-ddb2-4304-b5b2-eef1b2d40ba8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.758506] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('400096f0-ddb2-4304-b5b2-eef1b2d40ba8',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.999332] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ced2222f-152a-4951-8da3-65259a9e32af in Status: SUCCESS [ 1137.999673] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ced2222f-152a-4951-8da3-65259a9e32af deletion is rescheduled due to dependency. [ 1137.999673] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ced2222f-152a-4951-8da3-65259a9e32af" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.261219] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 400096f0-ddb2-4304-b5b2-eef1b2d40ba8 with status ACTIVE [ 1138.261436] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.261598] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.261675] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.261934] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.264039] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.264039] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.264039] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.264039] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.264039] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.264039] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.264039] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.264039] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.264039] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.264039] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.264039] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.264668] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 400096f0-ddb2-4304-b5b2-eef1b2d40ba8 is going to be updated. [ 1138.265680] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e717c4b-1f67-4d20-9afd-677fdceb923a taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.265879] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.266057] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e717c4b-1f67-4d20-9afd-677fdceb923a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.287016] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.287228] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.287317] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.287560] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.287731] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.287912] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-400096f0-ddb2-4304-b5b2-eef1b2d40ba8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.459721] env[70614]: INFO networking_nsxv3.common.synchronization [req-fea338b4-caf2-46b0-a966-89b199c4852b req-643da64e-a226-495e-8e0b-da37d2c89b62 tempest-ListServerFiltersTestJSON-738554284 tempest-ListServerFiltersTestJSON-738554284-project-member] Enqueued Resource ID: 9e717c4b-1f67-4d20-9afd-677fdceb923a with Priority: HIGHEST for action security_group_members [ 1138.459721] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e717c4b-1f67-4d20-9afd-677fdceb923a with Priority: HIGHEST for action security_group_members [ 1138.459721] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e717c4b-1f67-4d20-9afd-677fdceb923a taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.459721] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.769141] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e717c4b-1f67-4d20-9afd-677fdceb923a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.908917] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-435 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.908917] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-435" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.909324] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-435" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.909588] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-435" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.909911] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.910056] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.910201] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.910429] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.910576] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.910867] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1138.910949] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1138.910997] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1138.911455] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1138.911455] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1138.911455] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1138.911780] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1138.938560] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1138.939140] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1138.939140] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1138.939140] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-435" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.939408] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-c4694253-474e-4cb8-bbc0-6198552cc89b taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.939590] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-c4694253-474e-4cb8-bbc0-6198552cc89b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.939784] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-c4694253-474e-4cb8-bbc0-6198552cc89b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.940196] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-c4694253-474e-4cb8-bbc0-6198552cc89b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.940337] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4694253-474e-4cb8-bbc0-6198552cc89b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.112541] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 77761344-a891-4e31-9381-80451d04a355 in Status: SUCCESS [ 1139.112786] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-77761344-a891-4e31-9381-80451d04a355" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.273185] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.273321] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.273321] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.273919] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.273919] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.273997] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e717c4b-1f67-4d20-9afd-677fdceb923a is going to be created. [ 1139.302039] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.302039] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.302039] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.302312] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.302342] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.313470] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e717c4b-1f67-4d20-9afd-677fdceb923a in Status: UNINITIALIZED for 2s [ 1139.443024] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.443290] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.443433] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.443730] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.443886] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.444058] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port c4694253-474e-4cb8-bbc0-6198552cc89b not found, creating... [ 1139.444333] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.444483] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.444606] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.444831] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.444972] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.445272] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.445430] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.445552] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.445763] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.445922] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.446087] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: c4694253-474e-4cb8-bbc0-6198552cc89b is going to be created. [ 1139.467043] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.467272] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.467449] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.467682] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.467921] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.468196] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-c4694253-474e-4cb8-bbc0-6198552cc89b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.230073] env[70614]: INFO networking_nsxv3.common.synchronization [req-fea338b4-caf2-46b0-a966-89b199c4852b req-aba3b14d-ce5d-48f9-ac4a-cc0388772536 service nova] Enqueued Resource ID: 9e717c4b-1f67-4d20-9afd-677fdceb923a with Priority: HIGHEST for action security_group_rules [ 1140.230775] env[70614]: INFO networking_nsxv3.common.synchronization [req-fea338b4-caf2-46b0-a966-89b199c4852b req-aba3b14d-ce5d-48f9-ac4a-cc0388772536 service nova] Enqueued Resource ID: 9e717c4b-1f67-4d20-9afd-677fdceb923a with Priority: HIGHEST for action security_group_members [ 1140.231162] env[70614]: INFO networking_nsxv3.common.synchronization [req-fea338b4-caf2-46b0-a966-89b199c4852b req-aba3b14d-ce5d-48f9-ac4a-cc0388772536 service nova] Enqueued Resource ID: c4694253-474e-4cb8-bbc0-6198552cc89b with Priority: HIGHEST for action port [ 1140.233033] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e717c4b-1f67-4d20-9afd-677fdceb923a with Priority: HIGHEST for action security_group_rules [ 1140.233033] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e717c4b-1f67-4d20-9afd-677fdceb923a with Priority: HIGHEST for action security_group_members [ 1140.233033] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4694253-474e-4cb8-bbc0-6198552cc89b with Priority: HIGHEST for action port [ 1140.233229] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e717c4b-1f67-4d20-9afd-677fdceb923a taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.233538] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.233538] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e717c4b-1f67-4d20-9afd-677fdceb923a taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.233650] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.233925] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-c4694253-474e-4cb8-bbc0-6198552cc89b taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.234142] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c4694253-474e-4cb8-bbc0-6198552cc89b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.234142] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c4694253-474e-4cb8-bbc0-6198552cc89b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.234393] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c4694253-474e-4cb8-bbc0-6198552cc89b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.234495] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4694253-474e-4cb8-bbc0-6198552cc89b',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.574293] env[70614]: INFO networking_nsxv3.common.synchronization [req-4a27ce3b-edd8-4c60-9fd6-789664c8129d req-e07a276e-dc9c-4545-948b-feb44e037460 tempest-ServerDiskConfigTestJSON-2045015546 tempest-ServerDiskConfigTestJSON-2045015546-project-member] Enqueued Resource ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 with Priority: HIGHEST for action security_group_members [ 1140.574293] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 with Priority: HIGHEST for action security_group_members [ 1140.574293] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.574293] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.574587] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.574875] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.575160] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.575382] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.575534] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.575779] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.575959] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.576158] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94eb8a38-d1bf-4747-a73b-c4d0ea236bc3',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.739422] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c4694253-474e-4cb8-bbc0-6198552cc89b with status ACTIVE [ 1140.739422] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.739422] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.739422] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.739422] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.739422] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.739422] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.739422] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.739422] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.739422] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.739422] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.739422] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.739422] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.739422] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.739422] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.739422] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.739422] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c4694253-474e-4cb8-bbc0-6198552cc89b is going to be updated. [ 1140.769677] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.769677] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.769677] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.769677] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.769677] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.769677] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c4694253-474e-4cb8-bbc0-6198552cc89b" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.064395] env[70614]: INFO networking_nsxv3.common.synchronization [req-9a0880f8-6979-4b60-966e-c5dbbfcad7ab req-f34515b5-c31b-4b38-bb52-129b8b372c87 tempest-ListServerFiltersTestJSON-738554284 tempest-ListServerFiltersTestJSON-738554284-project-member] Enqueued Resource ID: 9e717c4b-1f67-4d20-9afd-677fdceb923a with Priority: HIGHEST for action security_group_members [ 1141.065024] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e717c4b-1f67-4d20-9afd-677fdceb923a with Priority: HIGHEST for action security_group_members [ 1141.065808] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e717c4b-1f67-4d20-9afd-677fdceb923a taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.065948] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.079660] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.079660] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.079660] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.079660] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.079660] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.083385] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.083385] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.083385] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.083385] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.083385] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.083385] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 is going to be updated. [ 1141.110225] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.110457] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.110555] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.110833] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.111022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.121223] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 in Status: IN_PROGRESS for 2s [ 1141.328840] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e717c4b-1f67-4d20-9afd-677fdceb923a in Status: SUCCESS [ 1141.328840] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.328840] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.328840] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.328840] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.330405] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.330405] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.330405] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.330405] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.330405] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.330405] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9e717c4b-1f67-4d20-9afd-677fdceb923a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.330686] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.330801] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.331048] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.331156] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.331294] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.331357] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.331415] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.331470] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e717c4b-1f67-4d20-9afd-677fdceb923a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.587630] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-435 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.587871] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-435" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.588018] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-435" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.588355] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-435" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.588677] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.588846] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.589033] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.590582] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.590582] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.590582] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1141.590582] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1141.590582] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1141.590582] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1141.590582] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1141.590582] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1141.590582] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1141.612580] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1141.612580] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1141.612787] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1141.613296] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-435" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.613427] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-3ab82c40-2f27-4967-8630-9c62fc098922 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.613558] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-3ab82c40-2f27-4967-8630-9c62fc098922" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.613671] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-3ab82c40-2f27-4967-8630-9c62fc098922" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.614316] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-3ab82c40-2f27-4967-8630-9c62fc098922" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.614316] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ab82c40-2f27-4967-8630-9c62fc098922',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.834630] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e717c4b-1f67-4d20-9afd-677fdceb923a taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.834630] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.837281] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e717c4b-1f67-4d20-9afd-677fdceb923a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.117398] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.117761] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.117999] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.118438] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.118696] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.118976] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 3ab82c40-2f27-4967-8630-9c62fc098922 not found, creating... [ 1142.119439] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.119723] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.119945] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.120335] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.120604] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.121096] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.121387] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.121618] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.121980] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.122263] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.122536] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 3ab82c40-2f27-4967-8630-9c62fc098922 is going to be created. [ 1142.144440] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.144833] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.145093] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.145531] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.145926] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.146363] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-3ab82c40-2f27-4967-8630-9c62fc098922" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.340984] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e717c4b-1f67-4d20-9afd-677fdceb923a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.843786] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.843786] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.843786] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.844015] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.844049] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.844249] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e717c4b-1f67-4d20-9afd-677fdceb923a is going to be updated. [ 1142.883104] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.883688] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.883797] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.884038] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.884196] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.895145] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e717c4b-1f67-4d20-9afd-677fdceb923a in Status: IN_PROGRESS for 2s [ 1143.132790] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 in Status: SUCCESS [ 1143.132790] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 deletion is rescheduled due to dependency. [ 1143.132790] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.327019] env[70614]: INFO networking_nsxv3.common.synchronization [req-b96d1bee-9797-4bfc-9a7b-a5dbaf5b29f6 req-eb26bf91-0c8c-4df5-9bd0-1ad657d14dd4 tempest-ServerActionsTestOtherB-1079543702 tempest-ServerActionsTestOtherB-1079543702-project-member] Enqueued Resource ID: 4e54f39e-349d-49ad-bb07-348488d846f0 with Priority: HIGHEST for action security_group_members [ 1143.327019] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e54f39e-349d-49ad-bb07-348488d846f0 with Priority: HIGHEST for action security_group_members [ 1143.327019] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e54f39e-349d-49ad-bb07-348488d846f0 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.327019] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.327019] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.327019] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.327019] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.327019] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.327019] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.327640] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.327834] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.328052] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e54f39e-349d-49ad-bb07-348488d846f0',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.805699] env[70614]: INFO networking_nsxv3.common.synchronization [req-9a0880f8-6979-4b60-966e-c5dbbfcad7ab req-9d18a262-fa8b-4aa1-b077-ecbf0c398e74 service nova] Enqueued Resource ID: 9e717c4b-1f67-4d20-9afd-677fdceb923a with Priority: HIGHEST for action security_group_rules [ 1143.805699] env[70614]: INFO networking_nsxv3.common.synchronization [req-9a0880f8-6979-4b60-966e-c5dbbfcad7ab req-9d18a262-fa8b-4aa1-b077-ecbf0c398e74 service nova] Enqueued Resource ID: 9e717c4b-1f67-4d20-9afd-677fdceb923a with Priority: HIGHEST for action security_group_members [ 1143.806181] env[70614]: INFO networking_nsxv3.common.synchronization [req-9a0880f8-6979-4b60-966e-c5dbbfcad7ab req-9d18a262-fa8b-4aa1-b077-ecbf0c398e74 service nova] Enqueued Resource ID: 3ab82c40-2f27-4967-8630-9c62fc098922 with Priority: HIGHEST for action port [ 1143.806181] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e717c4b-1f67-4d20-9afd-677fdceb923a with Priority: HIGHEST for action security_group_rules [ 1143.806181] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e717c4b-1f67-4d20-9afd-677fdceb923a with Priority: HIGHEST for action security_group_members [ 1143.806181] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ab82c40-2f27-4967-8630-9c62fc098922 with Priority: HIGHEST for action port [ 1143.808381] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e717c4b-1f67-4d20-9afd-677fdceb923a taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.808381] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.808381] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e717c4b-1f67-4d20-9afd-677fdceb923a taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.808381] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.808381] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ab82c40-2f27-4967-8630-9c62fc098922 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.808381] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ab82c40-2f27-4967-8630-9c62fc098922" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.808381] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ab82c40-2f27-4967-8630-9c62fc098922" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.808381] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ab82c40-2f27-4967-8630-9c62fc098922" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.808381] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ab82c40-2f27-4967-8630-9c62fc098922',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.833833] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.834086] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.834086] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.834314] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.834409] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.834652] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.834811] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.834811] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.834910] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.835305] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.835305] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e54f39e-349d-49ad-bb07-348488d846f0 is going to be updated. [ 1143.864880] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.864880] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.864880] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.864880] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.864880] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.875132] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e54f39e-349d-49ad-bb07-348488d846f0 in Status: IN_PROGRESS for 2s [ 1144.309962] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3ab82c40-2f27-4967-8630-9c62fc098922 with status ACTIVE [ 1144.310344] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.310537] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.310643] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.310946] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.310946] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.311133] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.311333] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.311415] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.311535] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.311640] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.311869] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.311979] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.312075] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.312371] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.312371] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.313061] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3ab82c40-2f27-4967-8630-9c62fc098922 is going to be updated. [ 1144.335306] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.335455] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.335532] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.335744] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.335896] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.336086] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ab82c40-2f27-4967-8630-9c62fc098922" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.907103] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e717c4b-1f67-4d20-9afd-677fdceb923a in Status: SUCCESS [ 1144.907103] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.907468] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.907468] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.907625] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.907688] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.907746] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.907901] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.908076] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.908076] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e717c4b-1f67-4d20-9afd-677fdceb923a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.410457] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e717c4b-1f67-4d20-9afd-677fdceb923a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.654603] env[70614]: INFO networking_nsxv3.common.synchronization [req-991e2b00-7bc6-49be-a306-f0069ca4f90d req-b57236e7-5832-4536-808f-8a831ccca8e4 tempest-ServersTestJSON-1535400473 tempest-ServersTestJSON-1535400473-project-member] Enqueued Resource ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 with Priority: HIGHEST for action security_group_members [ 1145.655373] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 with Priority: HIGHEST for action security_group_members [ 1145.655910] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-76d591d6-9294-4288-b5c9-f6b7e2b45562 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.656170] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.656220] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.656534] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.656657] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.656782] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.656837] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.658031] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.658110] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.658215] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.886816] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e54f39e-349d-49ad-bb07-348488d846f0 in Status: SUCCESS [ 1145.887032] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e54f39e-349d-49ad-bb07-348488d846f0 deletion is rescheduled due to dependency. [ 1145.887138] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.912494] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e717c4b-1f67-4d20-9afd-677fdceb923a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.970949] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-146 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.971278] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-146" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.971422] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-146" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.971700] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-146" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.972422] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.972603] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.972783] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.972988] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.973151] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.973369] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1145.973489] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1145.973600] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1145.973710] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1145.973823] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1145.973932] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1145.974085] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1145.995433] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1145.995632] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1145.995769] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1145.996057] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-146" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.996355] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-f433cd6a-3394-4cf4-a09e-ff09868d6438 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.996550] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-f433cd6a-3394-4cf4-a09e-ff09868d6438" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.997597] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-f433cd6a-3394-4cf4-a09e-ff09868d6438" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.997597] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-f433cd6a-3394-4cf4-a09e-ff09868d6438" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.997597] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f433cd6a-3394-4cf4-a09e-ff09868d6438',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.160771] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.414941] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.415782] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.415901] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.416245] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.416505] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.416682] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e717c4b-1f67-4d20-9afd-677fdceb923a is going to be updated. [ 1146.448381] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.448617] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.448617] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.448869] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.449120] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.464023] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e717c4b-1f67-4d20-9afd-677fdceb923a in Status: IN_PROGRESS for 2s [ 1146.499630] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.499866] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.500035] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.500741] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.500741] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.500741] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port f433cd6a-3394-4cf4-a09e-ff09868d6438 not found, creating... [ 1146.501064] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.501364] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.501579] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.501887] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.502097] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.502448] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.502806] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.503291] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.503444] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.503651] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.503901] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: f433cd6a-3394-4cf4-a09e-ff09868d6438 is going to be created. [ 1146.529506] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.529748] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.529884] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.530361] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.530792] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.531075] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-f433cd6a-3394-4cf4-a09e-ff09868d6438" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.664243] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.167646] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.167646] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.167974] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.167974] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.167974] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.168142] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 is going to be updated. [ 1147.200013] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.200200] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.200420] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.200718] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.201037] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.211434] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 in Status: IN_PROGRESS for 2s [ 1147.310915] env[70614]: INFO networking_nsxv3.common.synchronization [req-991e2b00-7bc6-49be-a306-f0069ca4f90d req-538964f5-f2a9-44e5-bbbc-513ca859e2d6 service nova] Enqueued Resource ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 with Priority: HIGHEST for action security_group_rules [ 1147.311243] env[70614]: INFO networking_nsxv3.common.synchronization [req-991e2b00-7bc6-49be-a306-f0069ca4f90d req-538964f5-f2a9-44e5-bbbc-513ca859e2d6 service nova] Enqueued Resource ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 with Priority: HIGHEST for action security_group_members [ 1147.311243] env[70614]: INFO networking_nsxv3.common.synchronization [req-991e2b00-7bc6-49be-a306-f0069ca4f90d req-538964f5-f2a9-44e5-bbbc-513ca859e2d6 service nova] Enqueued Resource ID: f433cd6a-3394-4cf4-a09e-ff09868d6438 with Priority: HIGHEST for action port [ 1147.311752] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 with Priority: HIGHEST for action security_group_rules [ 1147.311886] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 with Priority: HIGHEST for action security_group_members [ 1147.312020] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f433cd6a-3394-4cf4-a09e-ff09868d6438 with Priority: HIGHEST for action port [ 1147.312468] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-76d591d6-9294-4288-b5c9-f6b7e2b45562 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.312599] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.312663] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.312871] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.312957] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.313825] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-76d591d6-9294-4288-b5c9-f6b7e2b45562 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.313943] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.314484] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-f433cd6a-3394-4cf4-a09e-ff09868d6438 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.314484] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f433cd6a-3394-4cf4-a09e-ff09868d6438" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.314484] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f433cd6a-3394-4cf4-a09e-ff09868d6438" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.314711] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f433cd6a-3394-4cf4-a09e-ff09868d6438" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.314711] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f433cd6a-3394-4cf4-a09e-ff09868d6438',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.817532] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-76d591d6-9294-4288-b5c9-f6b7e2b45562 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.817532] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.822022] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f433cd6a-3394-4cf4-a09e-ff09868d6438 with status ACTIVE [ 1147.822022] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.822022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.822022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.822022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.822022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.822022] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.822022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.822022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.822022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.822022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.822022] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.822022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.822022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.822022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.822022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.822022] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f433cd6a-3394-4cf4-a09e-ff09868d6438 is going to be updated. [ 1147.844172] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.844696] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.844920] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.845276] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.845576] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.845866] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f433cd6a-3394-4cf4-a09e-ff09868d6438" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.475482] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e717c4b-1f67-4d20-9afd-677fdceb923a in Status: SUCCESS [ 1148.475853] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.475897] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.476165] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.476549] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.476549] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.476549] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.476726] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.476811] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.476928] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e717c4b-1f67-4d20-9afd-677fdceb923a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.979556] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e717c4b-1f67-4d20-9afd-677fdceb923a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.224261] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 in Status: SUCCESS [ 1149.224584] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.224764] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.225045] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.225297] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.225458] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.225553] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.225741] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.225860] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.225980] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.482182] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e717c4b-1f67-4d20-9afd-677fdceb923a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.729023] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.984916] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.985143] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.985225] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.985559] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.985673] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.985778] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e717c4b-1f67-4d20-9afd-677fdceb923a is going to be updated. [ 1150.016901] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.017125] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.017125] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.017328] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.017473] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.027451] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e717c4b-1f67-4d20-9afd-677fdceb923a in Status: IN_PROGRESS for 2s [ 1150.231418] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.734231] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.734539] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.734539] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.734725] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.734900] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.735046] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 is going to be updated. [ 1150.766661] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.766817] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.766869] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.767096] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.767247] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.776945] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 in Status: IN_PROGRESS for 2s [ 1152.039073] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e717c4b-1f67-4d20-9afd-677fdceb923a in Status: SUCCESS [ 1152.039466] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.039466] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.039624] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.039811] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.039963] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.040037] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.040148] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.040293] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.040406] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.040547] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e717c4b-1f67-4d20-9afd-677fdceb923a taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.040626] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.040677] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.040836] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.041092] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.041193] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.041277] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.041507] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.041586] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.041669] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.041757] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9e717c4b-1f67-4d20-9afd-677fdceb923a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.042620] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.042784] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.042935] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.043053] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.043120] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.043250] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.043325] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.043410] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e717c4b-1f67-4d20-9afd-677fdceb923a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.312932] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1152.313123] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=6 [ 1152.547074] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9e717c4b-1f67-4d20-9afd-677fdceb923a: rpc.has_security_group_logging(os_id): False [ 1152.547680] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e717c4b-1f67-4d20-9afd-677fdceb923a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.568230] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.568621] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.568742] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.568908] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.568987] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.569890] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.569890] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.569890] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.569890] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.569890] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.570387] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.570387] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.570387] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.570387] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.570387] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.570636] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.570636] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.570758] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.570811] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.570963] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.570963] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e717c4b-1f67-4d20-9afd-677fdceb923a is going to be created. [ 1152.632024] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.632024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.632024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.632024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.632024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.642964] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e717c4b-1f67-4d20-9afd-677fdceb923a in Status: IN_PROGRESS for 2s [ 1152.670765] env[70614]: INFO networking_nsxv3.common.synchronization [req-bcd6c121-3aba-4843-8865-bbe85d9135cd req-dbfb927f-c291-44c1-8ec6-616439c6c495 tempest-ServerDiskConfigTestJSON-2045015546 tempest-ServerDiskConfigTestJSON-2045015546-project-member] Enqueued Resource ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 with Priority: HIGHEST for action security_group_members [ 1152.671571] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 with Priority: HIGHEST for action security_group_members [ 1152.673505] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.673505] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.673505] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.673889] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.673889] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.673889] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.674017] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.674091] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.674176] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.674279] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94eb8a38-d1bf-4747-a73b-c4d0ea236bc3',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.808070] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 in Status: SUCCESS [ 1152.808426] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.808699] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.808877] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.809122] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.809274] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.809353] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.809596] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.810880] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.810880] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.810880] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.036326] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-498 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.036521] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-498" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.036685] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-498" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.036969] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-498" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.037246] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.037411] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.037535] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.037754] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.037901] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.038187] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1153.038306] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1153.038422] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1153.038538] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1153.038652] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1153.038762] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1153.038911] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1153.050696] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e717c4b-1f67-4d20-9afd-677fdceb923a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.059500] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1153.059675] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1153.059816] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1153.060011] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-498" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.060643] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-4a2a13c4-aa98-46ed-b462-391a4082e115 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.060897] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-4a2a13c4-aa98-46ed-b462-391a4082e115" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.061050] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-4a2a13c4-aa98-46ed-b462-391a4082e115" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.061432] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-4a2a13c4-aa98-46ed-b462-391a4082e115" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.061732] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a2a13c4-aa98-46ed-b462-391a4082e115',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.176523] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.176786] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.176873] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.177231] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.177388] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.177706] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.177850] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.177921] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.178139] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.178224] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.178367] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 is going to be updated. [ 1153.212919] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.212919] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.213211] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.213275] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.213415] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.222094] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 in Status: IN_PROGRESS for 2s [ 1153.313478] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-76d591d6-9294-4288-b5c9-f6b7e2b45562 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.313478] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.313478] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.313737] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.313846] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.313901] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.313933] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.314109] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.314194] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.314279] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.314435] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-76d591d6-9294-4288-b5c9-f6b7e2b45562 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.314534] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.314588] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.316015] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.316015] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.316015] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.316015] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.316015] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.316015] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.316015] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.316015] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.553477] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.553703] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.553750] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.553984] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.554094] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.554199] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e717c4b-1f67-4d20-9afd-677fdceb923a is going to be updated. [ 1153.564300] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.564560] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.564714] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.565096] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.565299] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.565479] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 4a2a13c4-aa98-46ed-b462-391a4082e115 not found, creating... [ 1153.565798] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.565970] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.566106] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.566338] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.566480] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.566785] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.566945] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.567076] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.567289] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.567426] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.567568] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 4a2a13c4-aa98-46ed-b462-391a4082e115 is going to be created. [ 1153.587117] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.587319] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.587383] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.587652] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.587792] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.590142] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.590363] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.590500] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.590754] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.590971] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.591208] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-4a2a13c4-aa98-46ed-b462-391a4082e115" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.605301] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e717c4b-1f67-4d20-9afd-677fdceb923a in Status: IN_PROGRESS for 2s [ 1153.820092] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 76d591d6-9294-4288-b5c9-f6b7e2b45562: rpc.has_security_group_logging(os_id): False [ 1153.845534] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.845534] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.845700] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.845914] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.846032] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.846261] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.846407] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.846483] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.846665] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.846747] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.846954] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.847101] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.847171] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.847331] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.847425] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.847654] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.847785] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.847854] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.848031] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.848113] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.848291] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 is going to be updated. [ 1153.912943] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.912943] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.912943] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.912943] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.912943] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.931090] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 in Status: IN_PROGRESS for 2s [ 1154.381027] env[70614]: INFO networking_nsxv3.common.synchronization [req-bcd6c121-3aba-4843-8865-bbe85d9135cd req-a7713cc1-7834-4e7a-a46f-1c001421cab6 service nova] Enqueued Resource ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 with Priority: HIGHEST for action security_group_rules [ 1154.381027] env[70614]: INFO networking_nsxv3.common.synchronization [req-bcd6c121-3aba-4843-8865-bbe85d9135cd req-a7713cc1-7834-4e7a-a46f-1c001421cab6 service nova] Enqueued Resource ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 with Priority: HIGHEST for action security_group_members [ 1154.381027] env[70614]: INFO networking_nsxv3.common.synchronization [req-bcd6c121-3aba-4843-8865-bbe85d9135cd req-a7713cc1-7834-4e7a-a46f-1c001421cab6 service nova] Enqueued Resource ID: 4a2a13c4-aa98-46ed-b462-391a4082e115 with Priority: HIGHEST for action port [ 1154.381027] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 with Priority: HIGHEST for action security_group_rules [ 1154.381027] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 with Priority: HIGHEST for action security_group_members [ 1154.381027] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a2a13c4-aa98-46ed-b462-391a4082e115 with Priority: HIGHEST for action port [ 1154.381027] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.382593] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.382866] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.383294] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.383649] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('94eb8a38-d1bf-4747-a73b-c4d0ea236bc3',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.386025] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.386025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.386025] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a2a13c4-aa98-46ed-b462-391a4082e115 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.386025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a2a13c4-aa98-46ed-b462-391a4082e115" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.386025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a2a13c4-aa98-46ed-b462-391a4082e115" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.386025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a2a13c4-aa98-46ed-b462-391a4082e115" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.386025] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a2a13c4-aa98-46ed-b462-391a4082e115',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.658657] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e717c4b-1f67-4d20-9afd-677fdceb923a in Status: SUCCESS [ 1154.658909] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.659128] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.659365] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.659458] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e717c4b-1f67-4d20-9afd-677fdceb923a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.888369] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.888527] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.888731] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4a2a13c4-aa98-46ed-b462-391a4082e115 with status ACTIVE [ 1154.888905] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.889027] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.889087] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.889427] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.889427] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.889534] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.889654] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.889703] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.889830] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.889912] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.890098] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.890278] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.890354] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.890455] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.890528] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.890625] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4a2a13c4-aa98-46ed-b462-391a4082e115 is going to be updated. [ 1154.922914] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.922914] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.922914] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.923204] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.923204] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.924143] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a2a13c4-aa98-46ed-b462-391a4082e115" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.162533] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e717c4b-1f67-4d20-9afd-677fdceb923a taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.162721] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.233101] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 in Status: SUCCESS [ 1155.233291] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 deletion is rescheduled due to dependency. [ 1155.233442] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.233598] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.233816] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.234015] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.234146] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.234213] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.234451] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.234451] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.234603] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94eb8a38-d1bf-4747-a73b-c4d0ea236bc3',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.616020] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e717c4b-1f67-4d20-9afd-677fdceb923a in Status: SUCCESS [ 1155.616422] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.616495] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.616729] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.616917] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.617124] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.617124] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.617252] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.617335] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.617423] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.617519] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9e717c4b-1f67-4d20-9afd-677fdceb923a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.737512] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('94eb8a38-d1bf-4747-a73b-c4d0ea236bc3',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.947058] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 in Status: SUCCESS [ 1155.947284] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.122135] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e717c4b-1f67-4d20-9afd-677fdceb923a taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.122298] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.122374] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.122608] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.122776] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.122878] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.122942] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.123106] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.123193] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.123282] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.123427] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e717c4b-1f67-4d20-9afd-677fdceb923a taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.123521] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.123582] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.123722] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.123879] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.123978] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.124052] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.124195] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.124272] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.124385] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.124485] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9e717c4b-1f67-4d20-9afd-677fdceb923a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.241108] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('94eb8a38-d1bf-4747-a73b-c4d0ea236bc3',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.628278] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9e717c4b-1f67-4d20-9afd-677fdceb923a: rpc.has_security_group_logging(os_id): False [ 1156.646575] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.646727] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.646797] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.647086] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.647975] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.647975] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.647975] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.647975] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.647975] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.647975] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.648216] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.648216] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.648284] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.648813] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.648935] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.649193] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.649687] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.649687] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.649687] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.649687] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.649687] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e717c4b-1f67-4d20-9afd-677fdceb923a is going to be updated. [ 1156.708878] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.709053] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.709109] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.709324] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.709508] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.722309] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e717c4b-1f67-4d20-9afd-677fdceb923a in Status: IN_PROGRESS for 2s [ 1156.742964] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.743166] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.743223] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.743567] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.743771] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.743927] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 is going to be updated. [ 1156.783165] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.783330] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.783382] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.783670] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.783827] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.792561] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 in Status: IN_PROGRESS for 2s [ 1158.736329] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e717c4b-1f67-4d20-9afd-677fdceb923a in Status: SUCCESS [ 1158.736729] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.736729] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.736888] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.737013] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e717c4b-1f67-4d20-9afd-677fdceb923a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.803989] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 in Status: SUCCESS [ 1158.804241] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.804416] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.804672] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.804889] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.805137] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.805272] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.805443] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.805516] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.805552] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.805645] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('94eb8a38-d1bf-4747-a73b-c4d0ea236bc3',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.239615] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e717c4b-1f67-4d20-9afd-677fdceb923a taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.239790] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.239835] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.240121] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.240366] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.240500] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.240540] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.240694] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.240781] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.240871] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.240962] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9e717c4b-1f67-4d20-9afd-677fdceb923a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.307945] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.308191] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.308299] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.308596] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.308820] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.308948] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.309053] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.309258] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.309377] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.309489] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.309669] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.309801] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.309894] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.310087] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.310302] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.310445] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.310519] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.310671] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.310747] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.310873] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.310975] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('94eb8a38-d1bf-4747-a73b-c4d0ea236bc3',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.380914] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1159.381110] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1159.743647] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e717c4b-1f67-4d20-9afd-677fdceb923a taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.744193] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.744193] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.744407] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.744647] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.744812] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.744875] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.745133] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.745236] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.745421] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.745542] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e717c4b-1f67-4d20-9afd-677fdceb923a taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.745674] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.745751] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.745939] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.746132] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.746260] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.746348] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.746507] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.746628] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.746734] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.746853] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9e717c4b-1f67-4d20-9afd-677fdceb923a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.813359] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3: rpc.has_security_group_logging(os_id): False [ 1159.832761] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.832761] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.832761] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.832761] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.832761] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.832761] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.832761] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.832761] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.833059] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.833090] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.833311] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.833401] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.833463] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.833608] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.833690] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.833921] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.834507] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.834704] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.834947] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.835102] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.835245] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 is going to be updated. [ 1159.927735] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.928099] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.928252] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.928755] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.928992] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.945597] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 in Status: IN_PROGRESS for 2s [ 1159.959690] env[70614]: INFO networking_nsxv3.common.synchronization [req-e46c8566-4727-49ce-9834-53efcf0c0913 req-adbdd233-90e0-4514-b728-3b9193b7db85 tempest-ServerActionsTestOtherB-1079543702 tempest-ServerActionsTestOtherB-1079543702-project-member] Enqueued Resource ID: 4e54f39e-349d-49ad-bb07-348488d846f0 with Priority: HIGHEST for action security_group_members [ 1159.960348] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e54f39e-349d-49ad-bb07-348488d846f0 with Priority: HIGHEST for action security_group_members [ 1159.960691] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e54f39e-349d-49ad-bb07-348488d846f0 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.960839] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.961091] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.961451] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.961661] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.961828] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.961932] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.962188] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.962338] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.962484] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e54f39e-349d-49ad-bb07-348488d846f0',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.007620] env[70614]: INFO networking_nsxv3.common.synchronization [req-0f354cc4-5a76-4f74-9b08-4f700ef75843 req-cb39cd85-e7dd-4250-9457-9f11af0d4ca4 tempest-ServersTestJSON-1535400473 tempest-ServersTestJSON-1535400473-project-member] Enqueued Resource ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 with Priority: HIGHEST for action security_group_members [ 1160.008756] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 with Priority: HIGHEST for action security_group_members [ 1160.009383] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-76d591d6-9294-4288-b5c9-f6b7e2b45562 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.009669] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.009861] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.010203] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.010507] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.010764] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.010900] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.011322] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.012285] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.012285] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.249823] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9e717c4b-1f67-4d20-9afd-677fdceb923a: rpc.has_security_group_logging(os_id): False [ 1160.268708] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.268858] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.268930] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.269253] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.269360] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.269610] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.269711] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.269745] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.269900] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.269980] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.270212] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.270379] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.270439] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.270582] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.270656] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.270862] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.270957] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.271427] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.271607] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.271740] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.271877] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e717c4b-1f67-4d20-9afd-677fdceb923a is going to be updated. [ 1160.337898] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.338725] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.338960] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.339223] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.339434] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.357628] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e717c4b-1f67-4d20-9afd-677fdceb923a in Status: IN_PROGRESS for 2s [ 1160.464448] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.464658] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.464732] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.465010] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.465133] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.465384] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.465537] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.465612] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.465826] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.465882] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.465983] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e54f39e-349d-49ad-bb07-348488d846f0 is going to be updated. [ 1160.502102] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.502513] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.502513] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.503416] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.503866] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.514830] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.520398] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e54f39e-349d-49ad-bb07-348488d846f0 in Status: IN_PROGRESS for 2s [ 1160.582709] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-883 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.582709] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-883" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.582855] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-883" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.584112] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-883" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.584485] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.585082] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.585082] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.585224] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.585364] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.585592] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1160.585713] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1160.585825] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1160.585951] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1160.586085] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1160.586953] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1160.586953] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1160.610621] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1160.610863] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1160.611066] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1160.611266] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-883" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.611836] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-a813a46d-1c96-4a19-8706-a37a0e70d990 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.611950] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-a813a46d-1c96-4a19-8706-a37a0e70d990" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.612064] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-a813a46d-1c96-4a19-8706-a37a0e70d990" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.612443] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-a813a46d-1c96-4a19-8706-a37a0e70d990" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.613417] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a813a46d-1c96-4a19-8706-a37a0e70d990',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.017664] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.115645] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.115875] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.115993] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.116296] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.116451] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.116680] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port a813a46d-1c96-4a19-8706-a37a0e70d990 not found, creating... [ 1161.116907] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.117088] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.117210] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.117436] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.117584] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.117864] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.118072] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.118221] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.118438] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.118578] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.118722] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: a813a46d-1c96-4a19-8706-a37a0e70d990 is going to be created. [ 1161.137809] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.138032] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.138136] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.138452] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.138693] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.138920] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-a813a46d-1c96-4a19-8706-a37a0e70d990" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.520430] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.520655] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.520718] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.520903] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.520995] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.521112] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 is going to be updated. [ 1161.551721] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.551721] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.551721] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.551721] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.551721] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.561096] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 in Status: IN_PROGRESS for 2s [ 1161.827096] env[70614]: INFO networking_nsxv3.common.synchronization [req-e46c8566-4727-49ce-9834-53efcf0c0913 req-91fe9a81-7885-4cb5-b720-38b89a2372d2 service nova] Enqueued Resource ID: 4e54f39e-349d-49ad-bb07-348488d846f0 with Priority: HIGHEST for action security_group_rules [ 1161.827325] env[70614]: INFO networking_nsxv3.common.synchronization [req-e46c8566-4727-49ce-9834-53efcf0c0913 req-91fe9a81-7885-4cb5-b720-38b89a2372d2 service nova] Enqueued Resource ID: 4e54f39e-349d-49ad-bb07-348488d846f0 with Priority: HIGHEST for action security_group_members [ 1161.827423] env[70614]: INFO networking_nsxv3.common.synchronization [req-e46c8566-4727-49ce-9834-53efcf0c0913 req-91fe9a81-7885-4cb5-b720-38b89a2372d2 service nova] Enqueued Resource ID: a813a46d-1c96-4a19-8706-a37a0e70d990 with Priority: HIGHEST for action port [ 1161.827650] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e54f39e-349d-49ad-bb07-348488d846f0 with Priority: HIGHEST for action security_group_rules [ 1161.827774] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e54f39e-349d-49ad-bb07-348488d846f0 with Priority: HIGHEST for action security_group_members [ 1161.827868] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a813a46d-1c96-4a19-8706-a37a0e70d990 with Priority: HIGHEST for action port [ 1161.828417] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e54f39e-349d-49ad-bb07-348488d846f0 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.828569] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.828605] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.828798] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.828870] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e54f39e-349d-49ad-bb07-348488d846f0',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.830057] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e54f39e-349d-49ad-bb07-348488d846f0 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.830383] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.830383] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-a813a46d-1c96-4a19-8706-a37a0e70d990 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.830678] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a813a46d-1c96-4a19-8706-a37a0e70d990" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.830678] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a813a46d-1c96-4a19-8706-a37a0e70d990" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.830678] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a813a46d-1c96-4a19-8706-a37a0e70d990" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.830839] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a813a46d-1c96-4a19-8706-a37a0e70d990',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.961772] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 in Status: SUCCESS [ 1161.962051] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.332545] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e54f39e-349d-49ad-bb07-348488d846f0 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.332850] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.333040] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a813a46d-1c96-4a19-8706-a37a0e70d990 with status ACTIVE [ 1162.333344] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.333544] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.333544] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.333782] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.333899] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.334097] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.334201] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.334329] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.334618] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.334661] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.334935] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.335106] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.335192] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.335412] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.335515] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.335611] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a813a46d-1c96-4a19-8706-a37a0e70d990 is going to be updated. [ 1162.398356] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e717c4b-1f67-4d20-9afd-677fdceb923a in Status: SUCCESS [ 1162.398712] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.404901] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.405229] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.405229] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.405513] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.405695] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.405894] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a813a46d-1c96-4a19-8706-a37a0e70d990" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.530726] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e54f39e-349d-49ad-bb07-348488d846f0 in Status: SUCCESS [ 1162.532076] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e54f39e-349d-49ad-bb07-348488d846f0 deletion is rescheduled due to dependency. [ 1162.532076] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.532076] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.532076] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.532076] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.532076] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.532076] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.532410] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.532410] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.532410] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e54f39e-349d-49ad-bb07-348488d846f0',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.035440] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4e54f39e-349d-49ad-bb07-348488d846f0',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.541519] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4e54f39e-349d-49ad-bb07-348488d846f0',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.570409] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 in Status: SUCCESS [ 1163.570643] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.044734] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.044901] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.044983] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.045255] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.045482] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.045482] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e54f39e-349d-49ad-bb07-348488d846f0 is going to be updated. [ 1164.078278] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.078518] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.078599] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.078799] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.078944] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.089089] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e54f39e-349d-49ad-bb07-348488d846f0 in Status: IN_PROGRESS for 2s [ 1166.100705] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e54f39e-349d-49ad-bb07-348488d846f0 in Status: SUCCESS [ 1166.101105] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.101105] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.101247] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.101453] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.101578] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.101643] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.101801] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.101879] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.101964] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.102070] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4e54f39e-349d-49ad-bb07-348488d846f0',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.605128] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4e54f39e-349d-49ad-bb07-348488d846f0',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.829756] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1166.829973] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1167.107437] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4e54f39e-349d-49ad-bb07-348488d846f0: rpc.has_security_group_logging(os_id): False [ 1167.126239] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.126442] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.126442] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.126627] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.126722] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.126971] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.127082] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.127146] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.127302] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.127378] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.127464] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e54f39e-349d-49ad-bb07-348488d846f0 is going to be updated. [ 1167.188096] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.188289] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.188349] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.188565] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.188713] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.205338] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e54f39e-349d-49ad-bb07-348488d846f0 in Status: IN_PROGRESS for 2s [ 1168.026495] env[70614]: INFO networking_nsxv3.common.synchronization [req-e0698adc-a204-40ec-81ff-dc8d3e85e31f req-c5dac48a-79f3-4526-9c0d-e7af567fd430 tempest-ListServerFiltersTestJSON-738554284 tempest-ListServerFiltersTestJSON-738554284-project-member] Enqueued Resource ID: 9e717c4b-1f67-4d20-9afd-677fdceb923a with Priority: HIGHEST for action security_group_members [ 1168.026634] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e717c4b-1f67-4d20-9afd-677fdceb923a with Priority: HIGHEST for action security_group_members [ 1168.026947] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e717c4b-1f67-4d20-9afd-677fdceb923a taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.027144] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.027264] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.027570] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.027724] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.027878] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.027953] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.028139] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.028262] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.028382] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e717c4b-1f67-4d20-9afd-677fdceb923a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.530871] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e717c4b-1f67-4d20-9afd-677fdceb923a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.033797] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e717c4b-1f67-4d20-9afd-677fdceb923a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.223648] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e54f39e-349d-49ad-bb07-348488d846f0 in Status: SUCCESS [ 1169.224010] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.536592] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.537012] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.537012] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.537088] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.537155] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.537256] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e717c4b-1f67-4d20-9afd-677fdceb923a is going to be updated. [ 1169.572596] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.572890] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.572890] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.573044] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.573228] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.585339] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e717c4b-1f67-4d20-9afd-677fdceb923a in Status: IN_PROGRESS for 2s [ 1170.773444] env[70614]: INFO networking_nsxv3.common.synchronization [req-1d796b48-a7d4-4276-8f40-9265e1ec1f5e req-5827335c-83ed-4ccc-afd6-f4d2db0b1a49 tempest-ServersTestJSON-1535400473 tempest-ServersTestJSON-1535400473-project-member] Enqueued Resource ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 with Priority: HIGHEST for action security_group_members [ 1170.773969] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 with Priority: HIGHEST for action security_group_members [ 1170.777623] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-76d591d6-9294-4288-b5c9-f6b7e2b45562 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.778457] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.778457] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.779325] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.779648] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.780551] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.780723] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.781019] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.781595] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.782119] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.078342] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-146 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.078582] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-146" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.078707] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-146" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.078986] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-146" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.079255] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.079408] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.079521] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.081039] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.081039] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.081039] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1171.081039] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1171.081039] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1171.081039] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1171.081039] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1171.081039] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1171.081039] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1171.102860] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1171.102860] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1171.103165] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1171.103165] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-146" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.103457] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-b2fa80ea-39e8-4098-8766-d55f18376b40 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.103702] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-b2fa80ea-39e8-4098-8766-d55f18376b40" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.103862] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-b2fa80ea-39e8-4098-8766-d55f18376b40" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.104236] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-b2fa80ea-39e8-4098-8766-d55f18376b40" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.104383] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2fa80ea-39e8-4098-8766-d55f18376b40',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.287909] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.596685] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e717c4b-1f67-4d20-9afd-677fdceb923a in Status: SUCCESS [ 1171.596893] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.606439] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.606704] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.606903] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.607311] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.607554] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.607807] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port b2fa80ea-39e8-4098-8766-d55f18376b40 not found, creating... [ 1171.608237] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.608501] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.608637] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.608879] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.609032] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.609337] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.609507] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.609620] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.609833] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.609970] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.610135] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: b2fa80ea-39e8-4098-8766-d55f18376b40 is going to be created. [ 1171.631992] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.632251] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.632384] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.632753] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.633021] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.633303] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-b2fa80ea-39e8-4098-8766-d55f18376b40" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.790410] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.293181] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.293357] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.293417] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.293629] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.293720] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.293818] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 is going to be updated. [ 1172.327313] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.327549] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.327602] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.327879] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.328072] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.339184] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 in Status: IN_PROGRESS for 2s [ 1172.606646] env[70614]: INFO networking_nsxv3.common.synchronization [req-1d796b48-a7d4-4276-8f40-9265e1ec1f5e req-0e95c574-cee2-425b-b2dd-c492bd4c186b service nova] Enqueued Resource ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 with Priority: HIGHEST for action security_group_rules [ 1172.606843] env[70614]: INFO networking_nsxv3.common.synchronization [req-1d796b48-a7d4-4276-8f40-9265e1ec1f5e req-0e95c574-cee2-425b-b2dd-c492bd4c186b service nova] Enqueued Resource ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 with Priority: HIGHEST for action security_group_members [ 1172.606974] env[70614]: INFO networking_nsxv3.common.synchronization [req-1d796b48-a7d4-4276-8f40-9265e1ec1f5e req-0e95c574-cee2-425b-b2dd-c492bd4c186b service nova] Enqueued Resource ID: b2fa80ea-39e8-4098-8766-d55f18376b40 with Priority: HIGHEST for action port [ 1172.607575] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 with Priority: HIGHEST for action security_group_rules [ 1172.607575] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 with Priority: HIGHEST for action security_group_members [ 1172.607575] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2fa80ea-39e8-4098-8766-d55f18376b40 with Priority: HIGHEST for action port [ 1172.609614] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-76d591d6-9294-4288-b5c9-f6b7e2b45562 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.609799] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.609871] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.610108] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.610188] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.611133] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-76d591d6-9294-4288-b5c9-f6b7e2b45562 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.611253] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.615106] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-b2fa80ea-39e8-4098-8766-d55f18376b40 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.615106] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b2fa80ea-39e8-4098-8766-d55f18376b40" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.615106] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b2fa80ea-39e8-4098-8766-d55f18376b40" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.615106] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b2fa80ea-39e8-4098-8766-d55f18376b40" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.615106] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2fa80ea-39e8-4098-8766-d55f18376b40',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.114339] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-76d591d6-9294-4288-b5c9-f6b7e2b45562 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.114339] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.117046] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b2fa80ea-39e8-4098-8766-d55f18376b40 with status ACTIVE [ 1173.117046] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.117046] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.117231] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.117289] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.117405] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.117543] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.117644] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.117704] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.117856] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.117967] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.118216] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.118338] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.118480] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.118596] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.118680] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.118881] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b2fa80ea-39e8-4098-8766-d55f18376b40 is going to be updated. [ 1173.140459] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.140692] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.140799] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.141147] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.141374] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.141621] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b2fa80ea-39e8-4098-8766-d55f18376b40" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.349603] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 in Status: SUCCESS [ 1174.349997] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.350091] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.350451] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.350727] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.350865] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.350927] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.351135] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.351221] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.351346] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.855169] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.296999] env[70614]: INFO networking_nsxv3.common.synchronization [req-c7b411ba-6f93-4f67-ace6-270ee7410e30 req-d6c2d553-ca54-4dcc-97f8-40fddd01e4b9 tempest-ListServerFiltersTestJSON-738554284 tempest-ListServerFiltersTestJSON-738554284-project-member] Enqueued Resource ID: 9e717c4b-1f67-4d20-9afd-677fdceb923a with Priority: HIGHEST for action security_group_members [ 1175.297511] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e717c4b-1f67-4d20-9afd-677fdceb923a with Priority: HIGHEST for action security_group_members [ 1175.297810] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e717c4b-1f67-4d20-9afd-677fdceb923a taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.297923] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.297990] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.298372] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.298372] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.298556] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.298556] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.298740] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.298892] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.298963] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e717c4b-1f67-4d20-9afd-677fdceb923a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.356543] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.800989] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e717c4b-1f67-4d20-9afd-677fdceb923a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.858975] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.859155] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.859227] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.859452] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.859545] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.859648] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 is going to be updated. [ 1175.887392] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.887589] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.887589] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.887807] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.887955] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.897132] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 in Status: IN_PROGRESS for 2s [ 1176.302914] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e717c4b-1f67-4d20-9afd-677fdceb923a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.805733] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.806216] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.806216] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.806302] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.806439] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.806566] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e717c4b-1f67-4d20-9afd-677fdceb923a is going to be updated. [ 1176.838739] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.838951] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.838951] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.839174] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.839329] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.848589] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e717c4b-1f67-4d20-9afd-677fdceb923a in Status: IN_PROGRESS for 2s [ 1177.430020] env[70614]: INFO networking_nsxv3.common.synchronization [req-3c7cf922-95e8-4932-962b-612371e03ad1 req-50abfbd9-a4a9-4a62-a7ff-ff6b83b7645f tempest-ServerActionsTestOtherA-302418031 tempest-ServerActionsTestOtherA-302418031-project-member] Enqueued Resource ID: 28809bb1-c80b-4696-9980-5f00f47130bb with Priority: HIGHEST for action security_group_members [ 1177.430020] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28809bb1-c80b-4696-9980-5f00f47130bb with Priority: HIGHEST for action security_group_members [ 1177.430481] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-28809bb1-c80b-4696-9980-5f00f47130bb taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.430481] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28809bb1-c80b-4696-9980-5f00f47130bb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.430591] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28809bb1-c80b-4696-9980-5f00f47130bb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.432197] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28809bb1-c80b-4696-9980-5f00f47130bb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.432197] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.432197] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.432197] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.432197] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.432197] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.432197] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28809bb1-c80b-4696-9980-5f00f47130bb',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.908349] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 in Status: SUCCESS [ 1177.908349] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.908349] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.908751] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.908751] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.908880] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.908919] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.909071] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.909153] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.909242] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.909345] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.934333] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.934581] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.934581] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.934706] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.954410] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.954655] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.954775] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.954848] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.955062] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.955135] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.955229] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28809bb1-c80b-4696-9980-5f00f47130bb is going to be updated. [ 1177.980367] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.980681] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.980740] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.980915] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.981070] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.990361] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28809bb1-c80b-4696-9980-5f00f47130bb in Status: IN_PROGRESS for 2s [ 1178.411261] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-76d591d6-9294-4288-b5c9-f6b7e2b45562 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.411560] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.411679] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.412013] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.412282] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.412453] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.412564] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.412805] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.412939] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.413101] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.413332] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-76d591d6-9294-4288-b5c9-f6b7e2b45562 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.413482] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.413584] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.413861] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.414040] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.414202] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.414301] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.414518] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.414654] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.414799] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.414946] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.531211] env[70614]: INFO networking_nsxv3.common.synchronization [req-bc609b2b-a615-45d4-97cc-50efd0e9def8 req-e8fae378-786c-4d0d-bd30-868aac11727a tempest-AttachVolumeTestJSON-892346173 tempest-AttachVolumeTestJSON-892346173-project-member] Enqueued Resource ID: 57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e with Priority: HIGHEST for action security_group_members [ 1178.531836] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e with Priority: HIGHEST for action security_group_members [ 1178.532322] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.532430] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.532430] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.532620] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.532786] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.532888] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.532951] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.533290] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.533381] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.533482] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.860315] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e717c4b-1f67-4d20-9afd-677fdceb923a in Status: SUCCESS [ 1178.860623] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.917367] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 76d591d6-9294-4288-b5c9-f6b7e2b45562: rpc.has_security_group_logging(os_id): False [ 1178.937254] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.937402] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.937472] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.937695] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.937787] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.937980] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.938094] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.938167] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.938324] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.938417] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.938608] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.938704] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.938763] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.938902] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.938976] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.939186] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.939285] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.939343] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.939518] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.939598] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.939685] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 is going to be updated. [ 1179.001413] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.001604] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.001678] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.001895] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.002075] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.016059] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 in Status: IN_PROGRESS for 2s [ 1179.035657] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.035822] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.035895] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.036152] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.036248] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.036441] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.036540] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.036597] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.036749] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.036824] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.036911] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e is going to be updated. [ 1179.075420] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.075600] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.075641] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.075836] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.075970] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.084747] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e in Status: IN_PROGRESS for 2s [ 1180.003286] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28809bb1-c80b-4696-9980-5f00f47130bb in Status: SUCCESS [ 1180.003682] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28809bb1-c80b-4696-9980-5f00f47130bb deletion is rescheduled due to dependency. [ 1180.003682] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28809bb1-c80b-4696-9980-5f00f47130bb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.042218] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 in Status: SUCCESS [ 1181.042580] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.098041] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e in Status: SUCCESS [ 1181.098362] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e deletion is rescheduled due to dependency. [ 1181.098544] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.038150] env[70614]: INFO networking_nsxv3.common.synchronization [req-9f9b67d3-6efd-4bdf-abb5-ed036a8fffc9 req-e5e9ffae-3a2d-49ba-b58d-ecbaf5de44ae tempest-ListServerFiltersTestJSON-738554284 tempest-ListServerFiltersTestJSON-738554284-project-member] Enqueued Resource ID: 9e717c4b-1f67-4d20-9afd-677fdceb923a with Priority: HIGHEST for action security_group_members [ 1182.038644] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e717c4b-1f67-4d20-9afd-677fdceb923a with Priority: HIGHEST for action security_group_members [ 1182.040128] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e717c4b-1f67-4d20-9afd-677fdceb923a taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.040128] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.040128] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.040128] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.040128] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.040128] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.040413] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.040539] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.041029] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.041029] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e717c4b-1f67-4d20-9afd-677fdceb923a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.543336] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.543770] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.543951] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.544450] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.544610] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.544959] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.545161] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.545257] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.545525] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.545664] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.545894] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e717c4b-1f67-4d20-9afd-677fdceb923a is going to be updated. [ 1182.582431] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.582779] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.582966] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.583332] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.583494] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.595983] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e717c4b-1f67-4d20-9afd-677fdceb923a in Status: IN_PROGRESS for 2s [ 1183.261169] env[70614]: INFO networking_nsxv3.common.synchronization [req-250c4da3-7155-48c5-9ec4-b5b3c823aeae req-3818353a-9283-4092-bbd3-481334d7a207 tempest-ServersTestJSON-1535400473 tempest-ServersTestJSON-1535400473-project-member] Enqueued Resource ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 with Priority: HIGHEST for action security_group_members [ 1183.261797] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 with Priority: HIGHEST for action security_group_members [ 1183.262113] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-76d591d6-9294-4288-b5c9-f6b7e2b45562 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.262235] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.262300] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.262503] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.262656] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.262793] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.262867] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.262972] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.263068] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.263162] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.765133] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.267293] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.608801] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e717c4b-1f67-4d20-9afd-677fdceb923a in Status: SUCCESS [ 1184.609018] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e717c4b-1f67-4d20-9afd-677fdceb923a deletion is rescheduled due to dependency. [ 1184.609156] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.769526] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.769949] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.769949] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.770076] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.770156] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.770258] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 is going to be updated. [ 1184.811790] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.812011] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.812011] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.812224] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.812370] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.821109] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 in Status: IN_PROGRESS for 2s [ 1186.536555] env[70614]: INFO networking_nsxv3.common.synchronization [req-0154a6ee-e68c-48e6-a73a-bb022bc2770b req-405ed0ef-f7b6-4ca6-a191-101eb1ebe1cc tempest-ServerActionsTestOtherA-302418031 tempest-ServerActionsTestOtherA-302418031-project-member] Enqueued Resource ID: ad8b8cdd-7eee-48c2-8c33-7b83fde75038 with Priority: HIGHEST for action security_group_members [ 1186.536982] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad8b8cdd-7eee-48c2-8c33-7b83fde75038 with Priority: HIGHEST for action security_group_members [ 1186.537299] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad8b8cdd-7eee-48c2-8c33-7b83fde75038 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.537420] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad8b8cdd-7eee-48c2-8c33-7b83fde75038" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.537487] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad8b8cdd-7eee-48c2-8c33-7b83fde75038" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.537687] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad8b8cdd-7eee-48c2-8c33-7b83fde75038" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.537834] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.537931] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.537994] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.538155] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.538243] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.538335] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad8b8cdd-7eee-48c2-8c33-7b83fde75038',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.828219] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-367 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.828447] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-367" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.828552] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-367" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.828902] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-367" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.829192] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.829392] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.829521] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.829794] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.829955] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.830194] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1186.830340] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1186.830507] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1186.830597] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1186.830713] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1186.830851] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1186.830999] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1186.833382] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 in Status: SUCCESS [ 1186.833592] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.849715] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1186.849882] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1186.850039] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1186.850228] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-367" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.850636] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-d5fff342-7069-47c4-b37e-d5d651858127 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.850865] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-d5fff342-7069-47c4-b37e-d5d651858127" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.850971] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-d5fff342-7069-47c4-b37e-d5d651858127" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.851363] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-d5fff342-7069-47c4-b37e-d5d651858127" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.851554] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5fff342-7069-47c4-b37e-d5d651858127',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.040864] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.041086] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.041211] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.041325] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.064263] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.064489] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.064579] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.064641] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.064850] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.064940] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.065031] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad8b8cdd-7eee-48c2-8c33-7b83fde75038 is going to be updated. [ 1187.094833] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.095029] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.095077] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.095258] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.095398] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.107193] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad8b8cdd-7eee-48c2-8c33-7b83fde75038 in Status: IN_PROGRESS for 2s [ 1187.354260] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.354500] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.354634] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.354925] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.355094] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.355258] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port d5fff342-7069-47c4-b37e-d5d651858127 not found, creating... [ 1187.355577] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.355719] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.356110] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.356173] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.356318] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.356609] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.356773] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.356894] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.357145] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.357325] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.357482] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: d5fff342-7069-47c4-b37e-d5d651858127 is going to be created. [ 1187.381068] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.381358] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.381448] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.381782] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.382031] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.382274] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-d5fff342-7069-47c4-b37e-d5d651858127" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.078023] env[70614]: INFO networking_nsxv3.common.synchronization [req-0154a6ee-e68c-48e6-a73a-bb022bc2770b req-0b2a8331-f1dc-41de-ab1b-2ddd4f511e28 service nova] Enqueued Resource ID: ad8b8cdd-7eee-48c2-8c33-7b83fde75038 with Priority: HIGHEST for action security_group_rules [ 1188.078023] env[70614]: INFO networking_nsxv3.common.synchronization [req-0154a6ee-e68c-48e6-a73a-bb022bc2770b req-0b2a8331-f1dc-41de-ab1b-2ddd4f511e28 service nova] Enqueued Resource ID: ad8b8cdd-7eee-48c2-8c33-7b83fde75038 with Priority: HIGHEST for action security_group_members [ 1188.078023] env[70614]: INFO networking_nsxv3.common.synchronization [req-0154a6ee-e68c-48e6-a73a-bb022bc2770b req-0b2a8331-f1dc-41de-ab1b-2ddd4f511e28 service nova] Enqueued Resource ID: d5fff342-7069-47c4-b37e-d5d651858127 with Priority: HIGHEST for action port [ 1188.078786] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad8b8cdd-7eee-48c2-8c33-7b83fde75038 with Priority: HIGHEST for action security_group_rules [ 1188.080696] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad8b8cdd-7eee-48c2-8c33-7b83fde75038 with Priority: HIGHEST for action security_group_members [ 1188.080696] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5fff342-7069-47c4-b37e-d5d651858127 with Priority: HIGHEST for action port [ 1188.080696] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad8b8cdd-7eee-48c2-8c33-7b83fde75038 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.080696] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad8b8cdd-7eee-48c2-8c33-7b83fde75038" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.080696] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad8b8cdd-7eee-48c2-8c33-7b83fde75038" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.080696] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad8b8cdd-7eee-48c2-8c33-7b83fde75038" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.080696] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad8b8cdd-7eee-48c2-8c33-7b83fde75038',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.081259] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad8b8cdd-7eee-48c2-8c33-7b83fde75038 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.081314] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad8b8cdd-7eee-48c2-8c33-7b83fde75038" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.081712] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-d5fff342-7069-47c4-b37e-d5d651858127 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.081712] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d5fff342-7069-47c4-b37e-d5d651858127" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.081853] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d5fff342-7069-47c4-b37e-d5d651858127" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.082022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d5fff342-7069-47c4-b37e-d5d651858127" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.082124] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5fff342-7069-47c4-b37e-d5d651858127',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.585583] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d5fff342-7069-47c4-b37e-d5d651858127 with status ACTIVE [ 1188.586169] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.586265] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.586335] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.586666] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.586827] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.587121] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.587236] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.587324] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.587597] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.587729] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.588045] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.588220] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.588327] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.588566] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.588684] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.588817] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d5fff342-7069-47c4-b37e-d5d651858127 is going to be updated. [ 1188.590675] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad8b8cdd-7eee-48c2-8c33-7b83fde75038 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.590883] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad8b8cdd-7eee-48c2-8c33-7b83fde75038" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.616668] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.616893] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.616893] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.617110] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.617246] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.617406] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d5fff342-7069-47c4-b37e-d5d651858127" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.116774] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad8b8cdd-7eee-48c2-8c33-7b83fde75038 in Status: SUCCESS [ 1189.117134] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad8b8cdd-7eee-48c2-8c33-7b83fde75038 deletion is rescheduled due to dependency. [ 1189.117134] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad8b8cdd-7eee-48c2-8c33-7b83fde75038" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.117204] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad8b8cdd-7eee-48c2-8c33-7b83fde75038" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.117443] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad8b8cdd-7eee-48c2-8c33-7b83fde75038" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.117640] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.117760] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.117820] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.117975] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.118073] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.118171] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad8b8cdd-7eee-48c2-8c33-7b83fde75038',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.620369] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ad8b8cdd-7eee-48c2-8c33-7b83fde75038',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.123094] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ad8b8cdd-7eee-48c2-8c33-7b83fde75038',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.625542] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.625709] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.625804] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.626033] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.626150] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.626183] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad8b8cdd-7eee-48c2-8c33-7b83fde75038 is going to be updated. [ 1190.658227] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.658439] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.658439] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.658640] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.658781] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.667143] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad8b8cdd-7eee-48c2-8c33-7b83fde75038 in Status: IN_PROGRESS for 2s [ 1191.205018] env[70614]: INFO networking_nsxv3.common.synchronization [req-e3d9195b-697c-4d4c-9170-cc56e7f485de req-dae1a650-ea66-4e84-8e19-5a49d4e9dea5 tempest-ServerActionsTestJSON-366333930 tempest-ServerActionsTestJSON-366333930-project-member] Enqueued Resource ID: 3496e6be-51c4-4b7a-9789-b13bae7f2cda with Priority: HIGHEST for action security_group_members [ 1191.206080] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3496e6be-51c4-4b7a-9789-b13bae7f2cda with Priority: HIGHEST for action security_group_members [ 1191.206080] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-3496e6be-51c4-4b7a-9789-b13bae7f2cda taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.206080] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3496e6be-51c4-4b7a-9789-b13bae7f2cda" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.206080] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3496e6be-51c4-4b7a-9789-b13bae7f2cda" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.206625] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3496e6be-51c4-4b7a-9789-b13bae7f2cda" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.206625] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.206625] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.206625] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.206811] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.206884] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.206998] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3496e6be-51c4-4b7a-9789-b13bae7f2cda',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.708716] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.708919] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.708968] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.709316] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.729959] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.730242] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.730360] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.730426] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.730696] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.730778] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.730871] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3496e6be-51c4-4b7a-9789-b13bae7f2cda is going to be updated. [ 1191.755271] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.755513] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.755584] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.755772] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.755937] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.765324] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3496e6be-51c4-4b7a-9789-b13bae7f2cda in Status: IN_PROGRESS for 2s [ 1192.304764] env[70614]: INFO networking_nsxv3.common.synchronization [None req-aed2de02-2db9-408e-b8d9-b71f23bc000f tempest-ServerDiskConfigTestJSON-2045015546 tempest-ServerDiskConfigTestJSON-2045015546-project-member] Enqueued Resource ID: fb8459c4-05e7-450d-8fc8-a50390fd48fa with Priority: HIGHEST for action security_group_rules [ 1192.305095] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb8459c4-05e7-450d-8fc8-a50390fd48fa with Priority: HIGHEST for action security_group_rules [ 1192.305662] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb8459c4-05e7-450d-8fc8-a50390fd48fa taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.305662] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb8459c4-05e7-450d-8fc8-a50390fd48fa" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.305662] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb8459c4-05e7-450d-8fc8-a50390fd48fa" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.306012] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb8459c4-05e7-450d-8fc8-a50390fd48fa" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.306179] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb8459c4-05e7-450d-8fc8-a50390fd48fa',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.383441] env[70614]: INFO networking_nsxv3.common.synchronization [None req-26a4dbb5-558b-49ea-bf1a-691f3b2b1a73 tempest-ServerDiskConfigTestJSON-2045015546 tempest-ServerDiskConfigTestJSON-2045015546-project-member] Enqueued Resource ID: fb8459c4-05e7-450d-8fc8-a50390fd48fa with Priority: HIGHEST for action security_group_rules [ 1192.383889] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb8459c4-05e7-450d-8fc8-a50390fd48fa with Priority: HIGHEST for action security_group_rules [ 1192.384212] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb8459c4-05e7-450d-8fc8-a50390fd48fa taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.384374] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb8459c4-05e7-450d-8fc8-a50390fd48fa" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.679554] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad8b8cdd-7eee-48c2-8c33-7b83fde75038 in Status: SUCCESS [ 1192.679832] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad8b8cdd-7eee-48c2-8c33-7b83fde75038" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.679936] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad8b8cdd-7eee-48c2-8c33-7b83fde75038" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.680262] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad8b8cdd-7eee-48c2-8c33-7b83fde75038" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.680389] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.680552] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.680634] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.680791] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.680870] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.680956] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad8b8cdd-7eee-48c2-8c33-7b83fde75038" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.681227] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ad8b8cdd-7eee-48c2-8c33-7b83fde75038',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.827366] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.827608] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.827608] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.827906] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.827990] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.828102] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb8459c4-05e7-450d-8fc8-a50390fd48fa already deleted. [ 1192.828184] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb8459c4-05e7-450d-8fc8-a50390fd48fa" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.828367] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb8459c4-05e7-450d-8fc8-a50390fd48fa" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.828563] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb8459c4-05e7-450d-8fc8-a50390fd48fa" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.828649] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb8459c4-05e7-450d-8fc8-a50390fd48fa',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.183456] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad8b8cdd-7eee-48c2-8c33-7b83fde75038 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.183717] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad8b8cdd-7eee-48c2-8c33-7b83fde75038" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.183717] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad8b8cdd-7eee-48c2-8c33-7b83fde75038" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.183933] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad8b8cdd-7eee-48c2-8c33-7b83fde75038" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.184116] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.184224] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.184289] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.186362] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.186362] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.186362] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad8b8cdd-7eee-48c2-8c33-7b83fde75038" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.186362] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad8b8cdd-7eee-48c2-8c33-7b83fde75038 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.186362] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad8b8cdd-7eee-48c2-8c33-7b83fde75038" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.186362] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad8b8cdd-7eee-48c2-8c33-7b83fde75038" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.186362] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad8b8cdd-7eee-48c2-8c33-7b83fde75038" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.186362] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.186362] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.186362] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.186362] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.186362] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.186362] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad8b8cdd-7eee-48c2-8c33-7b83fde75038" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.186362] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ad8b8cdd-7eee-48c2-8c33-7b83fde75038',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.351312] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.351914] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.351914] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.351914] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.352204] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.352204] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb8459c4-05e7-450d-8fc8-a50390fd48fa already deleted. [ 1193.352204] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb8459c4-05e7-450d-8fc8-a50390fd48fa" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.689325] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ad8b8cdd-7eee-48c2-8c33-7b83fde75038: rpc.has_security_group_logging(os_id): False [ 1193.707710] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.707901] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.707957] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.708269] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.708458] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.708656] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.708761] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.708850] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.709017] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.709109] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.709355] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.709428] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.709554] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.710313] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.710313] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.710313] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.710313] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.710313] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.710313] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.710493] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.710493] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad8b8cdd-7eee-48c2-8c33-7b83fde75038 is going to be updated. [ 1193.778021] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3496e6be-51c4-4b7a-9789-b13bae7f2cda in Status: SUCCESS [ 1193.778274] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3496e6be-51c4-4b7a-9789-b13bae7f2cda deletion is rescheduled due to dependency. [ 1193.778525] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3496e6be-51c4-4b7a-9789-b13bae7f2cda" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.779645] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.779843] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.779903] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.780106] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.780297] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.793986] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad8b8cdd-7eee-48c2-8c33-7b83fde75038 in Status: IN_PROGRESS for 2s [ 1195.082098] env[70614]: INFO networking_nsxv3.common.synchronization [req-6c02b137-c03d-4cce-b62e-f140978baad2 req-4525006e-2b72-429f-864f-875938e03b07 tempest-ServersTestJSON-1535400473 tempest-ServersTestJSON-1535400473-project-member] Enqueued Resource ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 with Priority: HIGHEST for action security_group_members [ 1195.082788] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 with Priority: HIGHEST for action security_group_members [ 1195.083195] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-76d591d6-9294-4288-b5c9-f6b7e2b45562 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.083348] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.083414] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.083640] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.084010] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.084114] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.084114] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.084333] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.084333] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.084437] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.588454] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.596022] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-146 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.596022] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-146" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.596022] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-146" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.596022] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-146" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.596022] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.596022] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.596022] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.596022] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.596022] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.596651] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1195.596920] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1195.597195] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1195.597449] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1195.597714] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1195.597968] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1195.598273] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1195.602366] env[70614]: INFO networking_nsxv3.common.synchronization [req-12031d11-2a5b-4a37-ac77-4b38e39a3c3b req-96d4e5ef-0444-4436-9567-175877e8088c tempest-ServerDiskConfigTestJSON-2045015546 tempest-ServerDiskConfigTestJSON-2045015546-project-member] Enqueued Resource ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 with Priority: HIGHEST for action security_group_members [ 1195.603540] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 with Priority: HIGHEST for action security_group_members [ 1195.604246] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.604529] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.604755] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.605090] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.605392] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.606913] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.606913] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.606913] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.606913] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.606913] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94eb8a38-d1bf-4747-a73b-c4d0ea236bc3',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.623917] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1195.624149] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1195.624377] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1195.624602] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-146" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.625011] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-0c4f1fb7-8963-46db-ae6a-e3664be8e019 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.625304] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-0c4f1fb7-8963-46db-ae6a-e3664be8e019" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.625456] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-0c4f1fb7-8963-46db-ae6a-e3664be8e019" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.625873] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-0c4f1fb7-8963-46db-ae6a-e3664be8e019" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.627419] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c4f1fb7-8963-46db-ae6a-e3664be8e019',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.809580] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad8b8cdd-7eee-48c2-8c33-7b83fde75038 in Status: SUCCESS [ 1195.809580] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad8b8cdd-7eee-48c2-8c33-7b83fde75038" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.090080] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.107923] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.108528] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.108528] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.108713] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.108772] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.109026] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.109169] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.109222] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.109370] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.109472] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.109542] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 is going to be updated. [ 1196.128895] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.129196] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.129334] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.129874] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.129874] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.129976] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 0c4f1fb7-8963-46db-ae6a-e3664be8e019 not found, creating... [ 1196.130199] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.130401] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.130480] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.130762] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.130899] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.131220] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.131383] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.131503] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.131773] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.131953] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.132127] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 0c4f1fb7-8963-46db-ae6a-e3664be8e019 is going to be created. [ 1196.148686] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.148897] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.148940] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.149286] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.149356] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.157041] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.157231] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.157614] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.157695] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.157979] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.158287] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-0c4f1fb7-8963-46db-ae6a-e3664be8e019" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.160045] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 in Status: IN_PROGRESS for 2s [ 1196.571132] env[70614]: INFO networking_nsxv3.common.synchronization [req-17a2483d-bc1a-49da-9143-dd8e6ddb3bbe req-fb8aee94-7e10-4b81-9fa2-d1a335b98bd4 tempest-ServerActionsTestOtherA-302418031 tempest-ServerActionsTestOtherA-302418031-project-member] Enqueued Resource ID: ad8b8cdd-7eee-48c2-8c33-7b83fde75038 with Priority: HIGHEST for action security_group_members [ 1196.571737] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad8b8cdd-7eee-48c2-8c33-7b83fde75038 with Priority: HIGHEST for action security_group_members [ 1196.572097] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad8b8cdd-7eee-48c2-8c33-7b83fde75038 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.572225] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad8b8cdd-7eee-48c2-8c33-7b83fde75038" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.572293] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad8b8cdd-7eee-48c2-8c33-7b83fde75038" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.572495] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad8b8cdd-7eee-48c2-8c33-7b83fde75038" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.572651] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.572748] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.572853] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.572943] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.574125] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.574441] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad8b8cdd-7eee-48c2-8c33-7b83fde75038',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.592209] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.592368] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.592444] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.592639] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.592724] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.592827] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 is going to be updated. [ 1196.634887] env[70614]: INFO networking_nsxv3.common.synchronization [req-17a2483d-bc1a-49da-9143-dd8e6ddb3bbe req-fb8aee94-7e10-4b81-9fa2-d1a335b98bd4 tempest-ServerActionsTestOtherA-302418031 tempest-ServerActionsTestOtherA-302418031-project-member] Enqueued Resource ID: d5fff342-7069-47c4-b37e-d5d651858127 with Priority: HIGHEST for action port [ 1196.635323] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5fff342-7069-47c4-b37e-d5d651858127 with Priority: HIGHEST for action port [ 1196.635828] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-d5fff342-7069-47c4-b37e-d5d651858127 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.636820] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d5fff342-7069-47c4-b37e-d5d651858127" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.637119] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d5fff342-7069-47c4-b37e-d5d651858127" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.637463] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d5fff342-7069-47c4-b37e-d5d651858127" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.637586] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5fff342-7069-47c4-b37e-d5d651858127',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.639970] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.640211] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.640211] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.640395] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.640595] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.653994] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 in Status: IN_PROGRESS for 2s [ 1197.079457] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.079651] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.079769] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.080041] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.080162] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.080403] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.080539] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.080612] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.080845] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.080947] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.081024] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad8b8cdd-7eee-48c2-8c33-7b83fde75038 is going to be updated. [ 1197.112072] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.112461] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.112461] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.112600] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.112650] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.121472] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad8b8cdd-7eee-48c2-8c33-7b83fde75038 in Status: IN_PROGRESS for 2s [ 1197.142961] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d5fff342-7069-47c4-b37e-d5d651858127 with status ACTIVE [ 1197.143254] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.143496] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.143496] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.143674] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.143769] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.143955] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.144074] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.144150] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.144285] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.144358] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.144547] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.144643] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.144699] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.144840] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.144909] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.144995] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d5fff342-7069-47c4-b37e-d5d651858127 is going to be updated. [ 1197.174032] env[70614]: INFO networking_nsxv3.common.synchronization [req-6c02b137-c03d-4cce-b62e-f140978baad2 req-037cf97c-640b-465d-b4d6-c716b3b1ce93 service nova] Enqueued Resource ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 with Priority: HIGHEST for action security_group_rules [ 1197.174228] env[70614]: INFO networking_nsxv3.common.synchronization [req-6c02b137-c03d-4cce-b62e-f140978baad2 req-037cf97c-640b-465d-b4d6-c716b3b1ce93 service nova] Enqueued Resource ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 with Priority: HIGHEST for action security_group_members [ 1197.174365] env[70614]: INFO networking_nsxv3.common.synchronization [req-6c02b137-c03d-4cce-b62e-f140978baad2 req-037cf97c-640b-465d-b4d6-c716b3b1ce93 service nova] Enqueued Resource ID: 0c4f1fb7-8963-46db-ae6a-e3664be8e019 with Priority: HIGHEST for action port [ 1197.175457] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.175622] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.175701] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.175827] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.177484] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.178486] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d5fff342-7069-47c4-b37e-d5d651858127" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.179310] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 with Priority: HIGHEST for action security_group_rules [ 1197.179465] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 with Priority: HIGHEST for action security_group_members [ 1197.179565] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c4f1fb7-8963-46db-ae6a-e3664be8e019 with Priority: HIGHEST for action port [ 1197.179880] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-76d591d6-9294-4288-b5c9-f6b7e2b45562 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.180053] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.180152] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.180409] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.180491] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.181476] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-76d591d6-9294-4288-b5c9-f6b7e2b45562 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.181614] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.181770] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-0c4f1fb7-8963-46db-ae6a-e3664be8e019 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.181878] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0c4f1fb7-8963-46db-ae6a-e3664be8e019" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.181943] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0c4f1fb7-8963-46db-ae6a-e3664be8e019" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.182124] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0c4f1fb7-8963-46db-ae6a-e3664be8e019" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.182193] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c4f1fb7-8963-46db-ae6a-e3664be8e019',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.685137] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-76d591d6-9294-4288-b5c9-f6b7e2b45562 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.685137] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.685409] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0c4f1fb7-8963-46db-ae6a-e3664be8e019 with status ACTIVE [ 1197.685513] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.685620] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.685705] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.686059] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.686208] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.686490] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.686649] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.686756] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.687052] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.687165] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.687444] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.687582] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.687649] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.687819] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.687884] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.688044] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0c4f1fb7-8963-46db-ae6a-e3664be8e019 is going to be updated. [ 1197.711137] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.711441] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.711441] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.711570] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.711715] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.711879] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0c4f1fb7-8963-46db-ae6a-e3664be8e019" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.170688] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 in Status: SUCCESS [ 1198.171103] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 deletion is rescheduled due to dependency. [ 1198.171103] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.663647] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 in Status: SUCCESS [ 1198.663823] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.663949] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.664181] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.664382] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.664508] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.664592] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.664771] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.664771] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.664858] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.132812] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad8b8cdd-7eee-48c2-8c33-7b83fde75038 in Status: SUCCESS [ 1199.133071] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad8b8cdd-7eee-48c2-8c33-7b83fde75038 deletion is rescheduled due to dependency. [ 1199.133862] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad8b8cdd-7eee-48c2-8c33-7b83fde75038" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.167091] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.669682] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.172362] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.172535] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.172699] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.172961] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.173113] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.173262] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 is going to be updated. [ 1200.203688] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.203839] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.203928] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.204193] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.204352] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.213481] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 in Status: IN_PROGRESS for 2s [ 1201.113767] env[70614]: INFO networking_nsxv3.common.synchronization [req-144411fe-8a68-48d4-ad5d-3a506e836720 req-9ff1546e-92b0-4258-a518-389a8616c188 tempest-ServerDiskConfigTestJSON-2045015546 tempest-ServerDiskConfigTestJSON-2045015546-project-member] Enqueued Resource ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 with Priority: HIGHEST for action security_group_members [ 1201.115050] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 with Priority: HIGHEST for action security_group_members [ 1201.115478] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.115701] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.115789] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.116166] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.116262] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.116424] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.116538] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.116836] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.116931] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.117082] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94eb8a38-d1bf-4747-a73b-c4d0ea236bc3',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.437030] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-498 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.437030] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-498" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.437030] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-498" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.437030] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-498" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.437030] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.437651] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.437932] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.438316] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.438613] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.439011] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1201.439289] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1201.439548] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1201.440409] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1201.440409] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1201.440409] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1201.440409] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1201.460515] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1201.460780] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1201.460963] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1201.461194] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-498" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.461670] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-0964a1f6-f2fe-4b81-8c02-f67f3f747e53 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.461863] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-0964a1f6-f2fe-4b81-8c02-f67f3f747e53" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.461990] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-0964a1f6-f2fe-4b81-8c02-f67f3f747e53" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.462419] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-0964a1f6-f2fe-4b81-8c02-f67f3f747e53" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.462498] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0964a1f6-f2fe-4b81-8c02-f67f3f747e53',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.622166] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.622347] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.622415] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.622611] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.622701] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.622908] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.623030] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.623088] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.623255] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.623324] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.623406] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 is going to be updated. [ 1201.650030] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.650030] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.650267] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.650267] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.650399] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.659547] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 in Status: IN_PROGRESS for 2s [ 1201.965103] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.965260] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.965393] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.965671] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.965833] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.965992] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 0964a1f6-f2fe-4b81-8c02-f67f3f747e53 not found, creating... [ 1201.966274] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.966434] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.966557] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.966845] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.967045] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.967342] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.967521] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.967644] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.967852] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.967990] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.968142] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 0964a1f6-f2fe-4b81-8c02-f67f3f747e53 is going to be created. [ 1201.987467] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.987693] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.987821] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.988510] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.988510] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.988626] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-0964a1f6-f2fe-4b81-8c02-f67f3f747e53" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.226459] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 in Status: SUCCESS [ 1202.226875] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.226959] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.227154] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.227348] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.227502] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.227559] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.227703] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.227789] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.227906] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.228057] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.681406] env[70614]: INFO networking_nsxv3.common.synchronization [req-144411fe-8a68-48d4-ad5d-3a506e836720 req-e4e4ccc1-ff2a-4e64-b750-ff7abc5fb507 service nova] Enqueued Resource ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 with Priority: HIGHEST for action security_group_rules [ 1202.681523] env[70614]: INFO networking_nsxv3.common.synchronization [req-144411fe-8a68-48d4-ad5d-3a506e836720 req-e4e4ccc1-ff2a-4e64-b750-ff7abc5fb507 service nova] Enqueued Resource ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 with Priority: HIGHEST for action security_group_members [ 1202.681725] env[70614]: INFO networking_nsxv3.common.synchronization [req-144411fe-8a68-48d4-ad5d-3a506e836720 req-e4e4ccc1-ff2a-4e64-b750-ff7abc5fb507 service nova] Enqueued Resource ID: 0964a1f6-f2fe-4b81-8c02-f67f3f747e53 with Priority: HIGHEST for action port [ 1202.682300] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 with Priority: HIGHEST for action security_group_rules [ 1202.682449] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 with Priority: HIGHEST for action security_group_members [ 1202.682550] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0964a1f6-f2fe-4b81-8c02-f67f3f747e53 with Priority: HIGHEST for action port [ 1202.683940] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.683940] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.683940] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.683940] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.683940] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('94eb8a38-d1bf-4747-a73b-c4d0ea236bc3',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.685082] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.685082] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.685322] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-0964a1f6-f2fe-4b81-8c02-f67f3f747e53 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.685389] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0964a1f6-f2fe-4b81-8c02-f67f3f747e53" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.686108] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0964a1f6-f2fe-4b81-8c02-f67f3f747e53" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.686108] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0964a1f6-f2fe-4b81-8c02-f67f3f747e53" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.686108] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0964a1f6-f2fe-4b81-8c02-f67f3f747e53',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.730905] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-76d591d6-9294-4288-b5c9-f6b7e2b45562 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.731202] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.731202] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.731439] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.731640] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.731762] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.731848] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.731988] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.732090] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.732181] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.732333] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-76d591d6-9294-4288-b5c9-f6b7e2b45562 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.732427] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.732481] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.732622] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.732758] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.732848] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.732919] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.733099] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.733175] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.733260] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.733350] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.188295] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.188295] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.188472] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0964a1f6-f2fe-4b81-8c02-f67f3f747e53 with status ACTIVE [ 1203.189213] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.189213] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.189213] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.189213] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.189425] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.189425] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.189520] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.189598] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.189730] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.189809] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.189988] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.190094] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.190156] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.190841] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.190841] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.190841] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0964a1f6-f2fe-4b81-8c02-f67f3f747e53 is going to be updated. [ 1203.212415] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.212570] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.212631] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.212842] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.212983] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.213154] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0964a1f6-f2fe-4b81-8c02-f67f3f747e53" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.235708] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 76d591d6-9294-4288-b5c9-f6b7e2b45562: rpc.has_security_group_logging(os_id): False [ 1203.260268] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.260519] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.260617] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.260862] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.260972] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.261203] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.261304] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.261366] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.261550] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.261633] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.261823] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.261912] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.261985] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.262154] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.262230] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.262429] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.262521] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.262581] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.262720] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.262792] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.262877] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 is going to be updated. [ 1203.329648] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.329830] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.329875] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.330093] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.330238] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.356266] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 in Status: IN_PROGRESS for 2s [ 1203.669189] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 in Status: SUCCESS [ 1203.669369] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 deletion is rescheduled due to dependency. [ 1203.669468] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.669634] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.669863] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.670080] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.670272] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.670272] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.670395] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.670470] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.670567] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94eb8a38-d1bf-4747-a73b-c4d0ea236bc3',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.173422] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('94eb8a38-d1bf-4747-a73b-c4d0ea236bc3',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.675804] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('94eb8a38-d1bf-4747-a73b-c4d0ea236bc3',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.178806] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.178995] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.179082] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.179269] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.179353] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.180025] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 is going to be updated. [ 1205.209687] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.209880] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.209925] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.210159] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.210295] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.220312] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 in Status: IN_PROGRESS for 2s [ 1205.370930] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 in Status: SUCCESS [ 1205.371105] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.233560] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 in Status: SUCCESS [ 1207.234088] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.234088] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.234245] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.234525] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.234683] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.234862] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.235035] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.235157] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.235271] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.235388] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('94eb8a38-d1bf-4747-a73b-c4d0ea236bc3',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.683614] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1207.683614] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1207.738161] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.738314] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.738408] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.738771] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.738954] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.739099] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.739164] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.739341] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.739431] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.739522] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.739675] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.739771] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.739847] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.739983] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.740139] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.740231] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.740294] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.740440] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.740517] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.740627] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.740748] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('94eb8a38-d1bf-4747-a73b-c4d0ea236bc3',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.246986] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3: rpc.has_security_group_logging(os_id): False [ 1208.265133] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.265305] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.265374] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.265736] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.265736] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.266469] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.266469] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.266469] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.266469] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.266469] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.266469] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.266469] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.266730] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.266730] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.266784] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.267093] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.267237] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.267334] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.267540] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.267654] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.267805] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 is going to be updated. [ 1208.339685] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.339915] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.339996] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.340284] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.340476] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.357930] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 in Status: IN_PROGRESS for 2s [ 1210.238096] env[70614]: INFO networking_nsxv3.common.synchronization [req-e69859a1-8eea-4b5a-99ca-06e250ceda92 req-65df7d4d-cc28-4fb1-a1bd-bb4ab26468da tempest-ServersTestJSON-1535400473 tempest-ServersTestJSON-1535400473-project-member] Enqueued Resource ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 with Priority: HIGHEST for action security_group_members [ 1210.238727] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 with Priority: HIGHEST for action security_group_members [ 1210.240698] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-76d591d6-9294-4288-b5c9-f6b7e2b45562 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.240698] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.240698] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.240698] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.240698] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.240698] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.240698] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.240698] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.240698] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.240698] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.375144] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 in Status: SUCCESS [ 1210.375144] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.556821] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-146 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.557077] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-146" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.557171] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-146" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.557460] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-146" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.557720] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.557881] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.558020] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.558428] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.559061] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.559061] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1210.559061] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1210.559262] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1210.559262] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1210.559335] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1210.559526] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1210.559594] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1210.579603] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1210.579794] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1210.579904] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1210.580118] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-146" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.580441] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-e7c99224-e13e-4c39-9cad-f05f4c304a60 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.580645] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-e7c99224-e13e-4c39-9cad-f05f4c304a60" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.580800] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-e7c99224-e13e-4c39-9cad-f05f4c304a60" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.581195] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-e7c99224-e13e-4c39-9cad-f05f4c304a60" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.581291] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7c99224-e13e-4c39-9cad-f05f4c304a60',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.742540] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.083581] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.083840] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.083939] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.084256] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.084408] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.084567] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port e7c99224-e13e-4c39-9cad-f05f4c304a60 not found, creating... [ 1211.084827] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.084988] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.085124] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.085347] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.085489] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.085772] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.085933] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.086063] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.086277] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.086413] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.086556] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: e7c99224-e13e-4c39-9cad-f05f4c304a60 is going to be created. [ 1211.125389] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.125612] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.126250] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.126250] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.126424] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.126710] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-e7c99224-e13e-4c39-9cad-f05f4c304a60" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.245026] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.747427] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.747667] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.747667] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.747871] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.747958] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.748079] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 is going to be updated. [ 1211.784483] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.784573] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.784573] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.785310] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.785310] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.795086] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 in Status: IN_PROGRESS for 2s [ 1211.809142] env[70614]: INFO networking_nsxv3.common.synchronization [req-e69859a1-8eea-4b5a-99ca-06e250ceda92 req-aa21d395-08c3-4026-a280-c0d73c1ba70d service nova] Enqueued Resource ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 with Priority: HIGHEST for action security_group_rules [ 1211.810285] env[70614]: INFO networking_nsxv3.common.synchronization [req-e69859a1-8eea-4b5a-99ca-06e250ceda92 req-aa21d395-08c3-4026-a280-c0d73c1ba70d service nova] Enqueued Resource ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 with Priority: HIGHEST for action security_group_members [ 1211.810484] env[70614]: INFO networking_nsxv3.common.synchronization [req-e69859a1-8eea-4b5a-99ca-06e250ceda92 req-aa21d395-08c3-4026-a280-c0d73c1ba70d service nova] Enqueued Resource ID: e7c99224-e13e-4c39-9cad-f05f4c304a60 with Priority: HIGHEST for action port [ 1211.811234] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 with Priority: HIGHEST for action security_group_rules [ 1211.811362] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 with Priority: HIGHEST for action security_group_members [ 1211.811495] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7c99224-e13e-4c39-9cad-f05f4c304a60 with Priority: HIGHEST for action port [ 1211.811816] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-76d591d6-9294-4288-b5c9-f6b7e2b45562 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.811969] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.812110] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.812359] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.812475] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.813535] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-76d591d6-9294-4288-b5c9-f6b7e2b45562 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.813535] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.814103] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-e7c99224-e13e-4c39-9cad-f05f4c304a60 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.814253] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e7c99224-e13e-4c39-9cad-f05f4c304a60" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.814350] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e7c99224-e13e-4c39-9cad-f05f4c304a60" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.814562] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e7c99224-e13e-4c39-9cad-f05f4c304a60" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.814680] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7c99224-e13e-4c39-9cad-f05f4c304a60',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.317061] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-76d591d6-9294-4288-b5c9-f6b7e2b45562 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.317517] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.317605] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e7c99224-e13e-4c39-9cad-f05f4c304a60 with status ACTIVE [ 1212.317904] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.318654] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.318654] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.318654] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.318836] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.319686] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.319686] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.319686] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.319893] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.319893] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.320236] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.320408] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.320537] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.320871] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.321040] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.321189] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e7c99224-e13e-4c39-9cad-f05f4c304a60 is going to be updated. [ 1212.344804] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.345088] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.345088] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.345237] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.345332] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.345498] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e7c99224-e13e-4c39-9cad-f05f4c304a60" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.806449] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 in Status: SUCCESS [ 1213.806863] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.806863] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.807165] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.807387] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.807534] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.807622] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.807807] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.807951] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.808110] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.311097] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.813737] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.315835] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.316062] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.316336] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.316336] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.316422] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.316459] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 is going to be updated. [ 1215.358904] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.359145] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.359205] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.359383] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.359534] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.369707] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 in Status: IN_PROGRESS for 2s [ 1216.812931] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1216.812931] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1217.381159] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 in Status: SUCCESS [ 1217.381467] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.381684] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.381916] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.382125] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.382245] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.382310] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.382654] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.382654] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.382654] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.382877] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.885113] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-76d591d6-9294-4288-b5c9-f6b7e2b45562 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.885513] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.885513] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.886188] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.886367] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.886559] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.886657] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.886831] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.886975] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.887051] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.887195] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-76d591d6-9294-4288-b5c9-f6b7e2b45562 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.887287] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.887483] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.887483] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.887625] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.887860] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.887860] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.887980] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.888051] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.888108] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.888181] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.391061] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 76d591d6-9294-4288-b5c9-f6b7e2b45562: rpc.has_security_group_logging(os_id): False [ 1218.410978] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.411226] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.411226] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.411409] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.411499] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.411691] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.411803] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.411870] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.412035] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.412113] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.412304] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.412397] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.412458] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.412601] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.412676] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.412919] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.413561] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.413672] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.413857] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.413947] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.414036] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 is going to be updated. [ 1218.477875] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.478071] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.478127] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.478523] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.478523] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.520460] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 in Status: IN_PROGRESS for 2s [ 1220.540362] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 in Status: SUCCESS [ 1220.540648] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.277381] env[70614]: INFO networking_nsxv3.common.synchronization [req-3c47aefa-40ab-4f0a-9f20-7ed04b313055 req-f1d36e9f-2015-4ee2-9cd2-3425d582dd20 tempest-ServerActionsTestOtherA-302418031 tempest-ServerActionsTestOtherA-302418031-project-member] Enqueued Resource ID: f58ad372-72ca-472a-aab5-8b86e9d2f1e6 with Priority: HIGHEST for action security_group_members [ 1221.277952] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f58ad372-72ca-472a-aab5-8b86e9d2f1e6 with Priority: HIGHEST for action security_group_members [ 1221.278324] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-f58ad372-72ca-472a-aab5-8b86e9d2f1e6 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.278427] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f58ad372-72ca-472a-aab5-8b86e9d2f1e6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.278467] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f58ad372-72ca-472a-aab5-8b86e9d2f1e6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.278664] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f58ad372-72ca-472a-aab5-8b86e9d2f1e6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.278809] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.278910] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.278961] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.281077] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.281234] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.281367] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f58ad372-72ca-472a-aab5-8b86e9d2f1e6',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.784370] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f58ad372-72ca-472a-aab5-8b86e9d2f1e6',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.943370] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-367 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.943527] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-367" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.943660] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-367" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.943937] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-367" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.944238] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.944416] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.944543] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.944778] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.944920] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.945405] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1221.945554] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1221.945701] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1221.945856] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1221.945983] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1221.946109] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1221.946251] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1221.966373] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1221.966566] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1221.966718] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1221.966888] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-367" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.967250] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-b8c6d95a-3df0-408b-b545-a8ab1e635e89 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.967440] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-b8c6d95a-3df0-408b-b545-a8ab1e635e89" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.967594] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-b8c6d95a-3df0-408b-b545-a8ab1e635e89" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.968029] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-b8c6d95a-3df0-408b-b545-a8ab1e635e89" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.968150] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8c6d95a-3df0-408b-b545-a8ab1e635e89',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.290130] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f58ad372-72ca-472a-aab5-8b86e9d2f1e6',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.470599] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.470941] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.471189] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.471533] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.471814] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.472036] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port b8c6d95a-3df0-408b-b545-a8ab1e635e89 not found, creating... [ 1222.472451] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.472687] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.473060] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.473351] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.473644] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.473958] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.474224] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.474440] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.474732] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.474982] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.475146] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: b8c6d95a-3df0-408b-b545-a8ab1e635e89 is going to be created. [ 1222.495872] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.496241] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.496444] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.496864] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.497161] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.497475] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-b8c6d95a-3df0-408b-b545-a8ab1e635e89" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.793581] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.794067] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.794067] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.794067] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.794249] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.794249] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f58ad372-72ca-472a-aab5-8b86e9d2f1e6 is going to be updated. [ 1222.829182] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.829318] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.829393] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.829703] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.829852] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.841228] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f58ad372-72ca-472a-aab5-8b86e9d2f1e6 in Status: IN_PROGRESS for 2s [ 1222.936579] env[70614]: INFO networking_nsxv3.common.synchronization [req-735a3f68-1d2e-49b8-87ec-dd8bd3c3eb3c req-2ac971bf-46b9-435f-adf7-78e3ebe753d4 tempest-ServersTestJSON-1535400473 tempest-ServersTestJSON-1535400473-project-member] Enqueued Resource ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 with Priority: HIGHEST for action security_group_members [ 1222.937145] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 with Priority: HIGHEST for action security_group_members [ 1222.937723] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-76d591d6-9294-4288-b5c9-f6b7e2b45562 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.937723] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.937723] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.937940] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.938190] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.938310] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.938379] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.938539] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.938640] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.938746] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.202427] env[70614]: INFO networking_nsxv3.common.synchronization [req-3c47aefa-40ab-4f0a-9f20-7ed04b313055 req-ccde109c-a039-4374-9ec3-286bf5ba16af service nova] Enqueued Resource ID: f58ad372-72ca-472a-aab5-8b86e9d2f1e6 with Priority: HIGHEST for action security_group_rules [ 1223.202687] env[70614]: INFO networking_nsxv3.common.synchronization [req-3c47aefa-40ab-4f0a-9f20-7ed04b313055 req-ccde109c-a039-4374-9ec3-286bf5ba16af service nova] Enqueued Resource ID: f58ad372-72ca-472a-aab5-8b86e9d2f1e6 with Priority: HIGHEST for action security_group_members [ 1223.202903] env[70614]: INFO networking_nsxv3.common.synchronization [req-3c47aefa-40ab-4f0a-9f20-7ed04b313055 req-ccde109c-a039-4374-9ec3-286bf5ba16af service nova] Enqueued Resource ID: b8c6d95a-3df0-408b-b545-a8ab1e635e89 with Priority: HIGHEST for action port [ 1223.204775] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f58ad372-72ca-472a-aab5-8b86e9d2f1e6 with Priority: HIGHEST for action security_group_rules [ 1223.204999] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f58ad372-72ca-472a-aab5-8b86e9d2f1e6 with Priority: HIGHEST for action security_group_members [ 1223.205593] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8c6d95a-3df0-408b-b545-a8ab1e635e89 with Priority: HIGHEST for action port [ 1223.205593] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f58ad372-72ca-472a-aab5-8b86e9d2f1e6 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.205814] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f58ad372-72ca-472a-aab5-8b86e9d2f1e6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.205897] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f58ad372-72ca-472a-aab5-8b86e9d2f1e6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.206253] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f58ad372-72ca-472a-aab5-8b86e9d2f1e6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.206362] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f58ad372-72ca-472a-aab5-8b86e9d2f1e6',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.208156] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-f58ad372-72ca-472a-aab5-8b86e9d2f1e6 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.208311] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f58ad372-72ca-472a-aab5-8b86e9d2f1e6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.208584] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-b8c6d95a-3df0-408b-b545-a8ab1e635e89 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.208758] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b8c6d95a-3df0-408b-b545-a8ab1e635e89" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.208758] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b8c6d95a-3df0-408b-b545-a8ab1e635e89" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.208889] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b8c6d95a-3df0-408b-b545-a8ab1e635e89" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.208983] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8c6d95a-3df0-408b-b545-a8ab1e635e89',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.442511] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.711785] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-f58ad372-72ca-472a-aab5-8b86e9d2f1e6 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.711785] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f58ad372-72ca-472a-aab5-8b86e9d2f1e6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.712579] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b8c6d95a-3df0-408b-b545-a8ab1e635e89 with status ACTIVE [ 1223.712579] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.712790] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.712833] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.713814] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.713814] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.713814] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.713814] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.713814] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.713814] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.714254] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.714289] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.714398] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.714479] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.714700] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.714770] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.714869] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b8c6d95a-3df0-408b-b545-a8ab1e635e89 is going to be updated. [ 1223.737353] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.737577] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.737625] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.738105] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.738318] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.738574] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b8c6d95a-3df0-408b-b545-a8ab1e635e89" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.944434] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.446593] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.446936] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.446936] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.447088] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.447183] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.447295] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 is going to be updated. [ 1224.493174] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.493405] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.493405] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.493679] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.493837] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.503565] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 in Status: IN_PROGRESS for 2s [ 1224.851482] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f58ad372-72ca-472a-aab5-8b86e9d2f1e6 in Status: SUCCESS [ 1224.851728] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f58ad372-72ca-472a-aab5-8b86e9d2f1e6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.851928] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f58ad372-72ca-472a-aab5-8b86e9d2f1e6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.852940] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f58ad372-72ca-472a-aab5-8b86e9d2f1e6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.852940] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.852940] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.852940] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.852940] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.852940] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.852940] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f58ad372-72ca-472a-aab5-8b86e9d2f1e6',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.355838] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f58ad372-72ca-472a-aab5-8b86e9d2f1e6',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.859205] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f58ad372-72ca-472a-aab5-8b86e9d2f1e6',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.361959] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.361959] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.361959] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.361959] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.362510] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.362510] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f58ad372-72ca-472a-aab5-8b86e9d2f1e6 is going to be updated. [ 1226.466473] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.466712] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.466712] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.467018] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.467186] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.477431] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f58ad372-72ca-472a-aab5-8b86e9d2f1e6 in Status: IN_PROGRESS for 2s [ 1226.513727] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 in Status: SUCCESS [ 1226.513959] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.206041] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1228.206041] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1228.492354] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f58ad372-72ca-472a-aab5-8b86e9d2f1e6 in Status: SUCCESS [ 1228.492612] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f58ad372-72ca-472a-aab5-8b86e9d2f1e6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.492727] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f58ad372-72ca-472a-aab5-8b86e9d2f1e6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.492960] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f58ad372-72ca-472a-aab5-8b86e9d2f1e6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.493209] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.493334] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.493402] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.493568] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.493648] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.493738] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f58ad372-72ca-472a-aab5-8b86e9d2f1e6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.493846] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f58ad372-72ca-472a-aab5-8b86e9d2f1e6',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.996661] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f58ad372-72ca-472a-aab5-8b86e9d2f1e6',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.499786] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f58ad372-72ca-472a-aab5-8b86e9d2f1e6: rpc.has_security_group_logging(os_id): False [ 1229.519692] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.519692] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.519692] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.520116] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.545689] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.546037] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.546174] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.546242] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.546453] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.546538] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.546648] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f58ad372-72ca-472a-aab5-8b86e9d2f1e6 is going to be updated. [ 1229.623038] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.623310] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.623310] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.623553] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.623777] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.638211] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f58ad372-72ca-472a-aab5-8b86e9d2f1e6 in Status: IN_PROGRESS for 2s [ 1230.399671] env[70614]: INFO networking_nsxv3.common.synchronization [req-05d22b32-ba99-4270-bc08-e3d9c4049f30 req-5fbb03c6-9fa4-4adb-9bf1-22ecfdb985f8 tempest-ServerActionsTestJSON-366333930 tempest-ServerActionsTestJSON-366333930-project-member] Enqueued Resource ID: def9aa42-470d-498e-9034-6879fb1e6ebc with Priority: HIGHEST for action security_group_members [ 1230.399999] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: def9aa42-470d-498e-9034-6879fb1e6ebc with Priority: HIGHEST for action security_group_members [ 1230.400337] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-def9aa42-470d-498e-9034-6879fb1e6ebc taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.400465] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.400529] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.400730] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.400963] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.401071] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.401139] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.401295] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.401384] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.401479] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('def9aa42-470d-498e-9034-6879fb1e6ebc',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.902518] env[70614]: INFO networking_nsxv3.common.synchronization [req-8f1180ad-860f-41c0-b2ac-57870e0dbe09 req-3815b41e-2f68-4ea1-b3a3-415d24e77081 tempest-ServersTestJSON-1535400473 tempest-ServersTestJSON-1535400473-project-member] Enqueued Resource ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 with Priority: HIGHEST for action security_group_members [ 1230.903077] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 with Priority: HIGHEST for action security_group_members [ 1230.903840] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.904069] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.904179] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.904413] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.904535] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.904753] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.904886] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.905442] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.905442] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.905442] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.905442] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: def9aa42-470d-498e-9034-6879fb1e6ebc is going to be updated. [ 1230.906766] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-76d591d6-9294-4288-b5c9-f6b7e2b45562 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.906876] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.907020] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.907195] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.907381] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.907526] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.907612] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.907777] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.907912] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.908891] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.939516] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.939664] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.939735] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.940038] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.940176] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.949506] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: def9aa42-470d-498e-9034-6879fb1e6ebc in Status: IN_PROGRESS for 2s [ 1231.410173] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.650178] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f58ad372-72ca-472a-aab5-8b86e9d2f1e6 in Status: SUCCESS [ 1231.650178] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f58ad372-72ca-472a-aab5-8b86e9d2f1e6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.913059] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.416208] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.416380] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.416483] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.416674] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.416765] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.416869] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 is going to be updated. [ 1232.444284] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.444455] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.444494] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.444739] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.444882] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.454813] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 in Status: IN_PROGRESS for 2s [ 1232.962025] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: def9aa42-470d-498e-9034-6879fb1e6ebc in Status: SUCCESS [ 1232.962025] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: def9aa42-470d-498e-9034-6879fb1e6ebc deletion is rescheduled due to dependency. [ 1232.962025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.467583] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 in Status: SUCCESS [ 1234.467583] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.903651] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1235.903973] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1240.904638] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1240.904936] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1241.884443] env[70614]: INFO networking_nsxv3.common.synchronization [req-3c17286d-f34b-4267-925a-fd258b2f2b3c req-860bbe34-9891-4365-b053-3b2256352632 tempest-ServerActionsTestJSON-366333930 tempest-ServerActionsTestJSON-366333930-project-member] Enqueued Resource ID: def9aa42-470d-498e-9034-6879fb1e6ebc with Priority: HIGHEST for action security_group_members [ 1241.884981] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: def9aa42-470d-498e-9034-6879fb1e6ebc with Priority: HIGHEST for action security_group_members [ 1241.885300] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-def9aa42-470d-498e-9034-6879fb1e6ebc taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.885417] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.885483] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.885674] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.885817] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.885911] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.885971] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.886127] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.886208] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.886296] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('def9aa42-470d-498e-9034-6879fb1e6ebc',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.388427] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.388809] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.388809] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.388959] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.389070] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.389270] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.389370] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.389430] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.389584] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.389659] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.389746] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: def9aa42-470d-498e-9034-6879fb1e6ebc is going to be updated. [ 1242.415387] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.415640] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.415640] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.415775] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.415950] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.425128] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: def9aa42-470d-498e-9034-6879fb1e6ebc in Status: IN_PROGRESS for 2s [ 1242.731213] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-117 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.731420] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-117" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.731550] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-117" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.731826] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-117" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.732120] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.732289] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.732410] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.732632] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.732788] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.732993] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1242.739027] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1242.739027] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1242.739027] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1242.739027] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1242.739027] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1242.739027] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1242.788807] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1242.789109] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.052 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1242.789179] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1242.789329] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-117" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.789736] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-8c3785f8-31ea-4ae3-b4cb-8c128e2d6447 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.789953] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-8c3785f8-31ea-4ae3-b4cb-8c128e2d6447" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.790164] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-8c3785f8-31ea-4ae3-b4cb-8c128e2d6447" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.790543] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-8c3785f8-31ea-4ae3-b4cb-8c128e2d6447" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.790695] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c3785f8-31ea-4ae3-b4cb-8c128e2d6447',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.894375] env[70614]: INFO networking_nsxv3.common.synchronization [req-78414037-c4ff-4b51-b1c8-7b9ce5c1ffdf req-e7bab631-f166-4d31-a7c1-23af3a3ff59e tempest-ServerRescueNegativeTestJSON-1616269448 tempest-ServerRescueNegativeTestJSON-1616269448-project-member] Enqueued Resource ID: 77761344-a891-4e31-9381-80451d04a355 with Priority: HIGHEST for action security_group_members [ 1242.895074] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77761344-a891-4e31-9381-80451d04a355 with Priority: HIGHEST for action security_group_members [ 1242.895564] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-77761344-a891-4e31-9381-80451d04a355 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.895694] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77761344-a891-4e31-9381-80451d04a355" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.895739] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77761344-a891-4e31-9381-80451d04a355" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.896103] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77761344-a891-4e31-9381-80451d04a355" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.896103] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.896226] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.896260] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.896383] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.896499] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.896606] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77761344-a891-4e31-9381-80451d04a355',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.899731] env[70614]: INFO networking_nsxv3.common.synchronization [req-d80ec0da-4030-483d-91bc-5a7fb6181136 req-875b5c8a-5120-4aca-9d3d-606f8a4ba3b7 tempest-ServerDiskConfigTestJSON-2045015546 tempest-ServerDiskConfigTestJSON-2045015546-project-member] Enqueued Resource ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 with Priority: HIGHEST for action security_group_members [ 1242.899879] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 with Priority: HIGHEST for action security_group_members [ 1242.900359] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.900506] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.900573] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.900689] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.900825] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.900938] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.900995] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.901150] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.901233] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.901539] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94eb8a38-d1bf-4747-a73b-c4d0ea236bc3',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.293645] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.293927] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.294073] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.294393] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.294547] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.294708] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 8c3785f8-31ea-4ae3-b4cb-8c128e2d6447 not found, creating... [ 1243.294999] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.295200] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.295323] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.295552] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.295689] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.295982] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.296157] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.296275] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.296484] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.296617] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.296757] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 8c3785f8-31ea-4ae3-b4cb-8c128e2d6447 is going to be created. [ 1243.319567] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.319786] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.319907] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.320209] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.320440] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.320663] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-8c3785f8-31ea-4ae3-b4cb-8c128e2d6447" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.399105] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.399545] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.399545] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.399545] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.399659] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.399824] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.399922] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.399985] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.400153] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.400228] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.400316] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77761344-a891-4e31-9381-80451d04a355 is going to be updated. [ 1243.403195] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.403359] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.403403] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.403548] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.403628] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.403813] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.403909] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.403974] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.404132] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.404204] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.404289] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 is going to be updated. [ 1243.447771] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.448018] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.448018] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.448212] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.448357] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.450516] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.450663] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.450663] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.450808] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.451020] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.461244] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77761344-a891-4e31-9381-80451d04a355 in Status: IN_PROGRESS for 2s [ 1243.464155] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 in Status: IN_PROGRESS for 2s [ 1244.079233] env[70614]: INFO networking_nsxv3.common.synchronization [req-3c17286d-f34b-4267-925a-fd258b2f2b3c req-3060a59d-dd72-4af6-868f-9fd1d0f6bbde service nova] Enqueued Resource ID: def9aa42-470d-498e-9034-6879fb1e6ebc with Priority: HIGHEST for action security_group_rules [ 1244.079410] env[70614]: INFO networking_nsxv3.common.synchronization [req-3c17286d-f34b-4267-925a-fd258b2f2b3c req-3060a59d-dd72-4af6-868f-9fd1d0f6bbde service nova] Enqueued Resource ID: def9aa42-470d-498e-9034-6879fb1e6ebc with Priority: HIGHEST for action security_group_members [ 1244.079551] env[70614]: INFO networking_nsxv3.common.synchronization [req-3c17286d-f34b-4267-925a-fd258b2f2b3c req-3060a59d-dd72-4af6-868f-9fd1d0f6bbde service nova] Enqueued Resource ID: 8c3785f8-31ea-4ae3-b4cb-8c128e2d6447 with Priority: HIGHEST for action port [ 1244.079792] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: def9aa42-470d-498e-9034-6879fb1e6ebc with Priority: HIGHEST for action security_group_rules [ 1244.079917] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: def9aa42-470d-498e-9034-6879fb1e6ebc with Priority: HIGHEST for action security_group_members [ 1244.080022] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c3785f8-31ea-4ae3-b4cb-8c128e2d6447 with Priority: HIGHEST for action port [ 1244.080715] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-def9aa42-470d-498e-9034-6879fb1e6ebc taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.080922] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.081017] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.081258] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.081375] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('def9aa42-470d-498e-9034-6879fb1e6ebc',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.082218] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-def9aa42-470d-498e-9034-6879fb1e6ebc taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.082309] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.082560] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-8c3785f8-31ea-4ae3-b4cb-8c128e2d6447 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.082691] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8c3785f8-31ea-4ae3-b4cb-8c128e2d6447" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.082776] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8c3785f8-31ea-4ae3-b4cb-8c128e2d6447" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.082983] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8c3785f8-31ea-4ae3-b4cb-8c128e2d6447" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.083096] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c3785f8-31ea-4ae3-b4cb-8c128e2d6447',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.260769] env[70614]: INFO networking_nsxv3.common.synchronization [req-c851b605-bdba-41cd-b691-35b73c0ea928 req-1e0e57af-ecf3-456d-8c57-593e2ba533bc tempest-ServersTestJSON-1535400473 tempest-ServersTestJSON-1535400473-project-member] Enqueued Resource ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 with Priority: HIGHEST for action security_group_members [ 1244.261375] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 with Priority: HIGHEST for action security_group_members [ 1244.262028] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-76d591d6-9294-4288-b5c9-f6b7e2b45562 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.262028] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.262028] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.262224] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.262296] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.262376] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.262431] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.262591] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.262678] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.262770] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.436111] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: def9aa42-470d-498e-9034-6879fb1e6ebc in Status: SUCCESS [ 1244.436359] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: def9aa42-470d-498e-9034-6879fb1e6ebc deletion is rescheduled due to dependency. [ 1244.436412] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.436577] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.436787] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.436969] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.437100] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.437168] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.437320] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.437401] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.437493] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('def9aa42-470d-498e-9034-6879fb1e6ebc',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.572281] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-146 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.572491] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-146" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.572619] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-146" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.572892] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-146" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.573238] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.573418] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.573543] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.573768] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.573919] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.574145] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1244.574264] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1244.574379] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1244.574491] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1244.574635] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1244.574764] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1244.574902] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1244.584873] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-def9aa42-470d-498e-9034-6879fb1e6ebc taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.584995] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.586282] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8c3785f8-31ea-4ae3-b4cb-8c128e2d6447 with status ACTIVE [ 1244.586448] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.586557] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.586624] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.586818] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.586907] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.587148] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.587260] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.587324] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.587475] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.587552] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.587736] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.587841] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.587881] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.588032] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.588147] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.588189] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8c3785f8-31ea-4ae3-b4cb-8c128e2d6447 is going to be updated. [ 1244.600110] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1244.600190] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1244.600326] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1244.600549] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-146" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.600935] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-89d9fac8-4069-4046-b9ed-3784869e08bd taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.601145] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-89d9fac8-4069-4046-b9ed-3784869e08bd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.601256] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-89d9fac8-4069-4046-b9ed-3784869e08bd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.601629] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-89d9fac8-4069-4046-b9ed-3784869e08bd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.601787] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89d9fac8-4069-4046-b9ed-3784869e08bd',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.625192] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.625382] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.625486] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.625671] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.625890] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.626079] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8c3785f8-31ea-4ae3-b4cb-8c128e2d6447" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.765160] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.940461] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('def9aa42-470d-498e-9034-6879fb1e6ebc',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.104052] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.104275] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.104468] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.104925] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.105244] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.105483] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 89d9fac8-4069-4046-b9ed-3784869e08bd not found, creating... [ 1245.105721] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.105887] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.106017] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.106252] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.106392] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.106676] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.106868] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.107025] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.107245] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.107383] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.107564] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 89d9fac8-4069-4046-b9ed-3784869e08bd is going to be created. [ 1245.126352] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.126627] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.126731] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.126945] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.127207] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.127433] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-89d9fac8-4069-4046-b9ed-3784869e08bd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.268183] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.443336] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('def9aa42-470d-498e-9034-6879fb1e6ebc',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.472623] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77761344-a891-4e31-9381-80451d04a355 in Status: SUCCESS [ 1245.472889] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77761344-a891-4e31-9381-80451d04a355 deletion is rescheduled due to dependency. [ 1245.473056] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77761344-a891-4e31-9381-80451d04a355" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.473852] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 in Status: SUCCESS [ 1245.474069] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 deletion is rescheduled due to dependency. [ 1245.474226] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.770353] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.770583] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.770638] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.770841] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.770980] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.771104] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 is going to be updated. [ 1245.804753] env[70614]: INFO networking_nsxv3.common.synchronization [req-c851b605-bdba-41cd-b691-35b73c0ea928 req-2305c1fe-e4f0-464d-9bb7-94d5946eca4a service nova] Enqueued Resource ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 with Priority: HIGHEST for action security_group_rules [ 1245.804940] env[70614]: INFO networking_nsxv3.common.synchronization [req-c851b605-bdba-41cd-b691-35b73c0ea928 req-2305c1fe-e4f0-464d-9bb7-94d5946eca4a service nova] Enqueued Resource ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 with Priority: HIGHEST for action security_group_members [ 1245.805091] env[70614]: INFO networking_nsxv3.common.synchronization [req-c851b605-bdba-41cd-b691-35b73c0ea928 req-2305c1fe-e4f0-464d-9bb7-94d5946eca4a service nova] Enqueued Resource ID: 89d9fac8-4069-4046-b9ed-3784869e08bd with Priority: HIGHEST for action port [ 1245.806536] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.806536] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.806536] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.806536] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.806760] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.807648] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 with Priority: HIGHEST for action security_group_rules [ 1245.807776] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 with Priority: HIGHEST for action security_group_members [ 1245.807864] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89d9fac8-4069-4046-b9ed-3784869e08bd with Priority: HIGHEST for action port [ 1245.808728] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-76d591d6-9294-4288-b5c9-f6b7e2b45562 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.808728] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.808728] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.808891] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.808891] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.810217] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-76d591d6-9294-4288-b5c9-f6b7e2b45562 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.810322] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.810420] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-89d9fac8-4069-4046-b9ed-3784869e08bd taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.810507] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-89d9fac8-4069-4046-b9ed-3784869e08bd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.810576] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-89d9fac8-4069-4046-b9ed-3784869e08bd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.810727] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-89d9fac8-4069-4046-b9ed-3784869e08bd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.810801] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89d9fac8-4069-4046-b9ed-3784869e08bd',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.820195] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 in Status: IN_PROGRESS for 2s [ 1245.947055] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.947055] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.947055] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.947055] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.947055] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.947055] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: def9aa42-470d-498e-9034-6879fb1e6ebc is going to be updated. [ 1245.975772] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.975926] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.976007] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.976241] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.976386] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.991076] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: def9aa42-470d-498e-9034-6879fb1e6ebc in Status: IN_PROGRESS for 2s [ 1246.312915] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 89d9fac8-4069-4046-b9ed-3784869e08bd with status ACTIVE [ 1246.313213] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.313328] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.313443] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.313694] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.313812] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.314025] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.314144] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.314269] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.314357] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.314405] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.314590] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.314693] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.314730] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.314868] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.314947] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.315043] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 89d9fac8-4069-4046-b9ed-3784869e08bd is going to be updated. [ 1246.316267] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-76d591d6-9294-4288-b5c9-f6b7e2b45562 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.316384] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.335676] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.335865] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.335865] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.336084] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.336221] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.336374] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-89d9fac8-4069-4046-b9ed-3784869e08bd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.831661] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 in Status: SUCCESS [ 1247.832081] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.832081] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.832317] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.832504] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.832643] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.832685] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.832852] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.832966] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.833122] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.001367] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: def9aa42-470d-498e-9034-6879fb1e6ebc in Status: SUCCESS [ 1248.001691] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.001807] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.002063] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.002264] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.002384] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.002445] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.002603] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.002681] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.002768] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.002884] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('def9aa42-470d-498e-9034-6879fb1e6ebc',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.335586] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.505524] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('def9aa42-470d-498e-9034-6879fb1e6ebc',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.837796] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.008463] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for def9aa42-470d-498e-9034-6879fb1e6ebc: rpc.has_security_group_logging(os_id): False [ 1249.026879] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.027076] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.027076] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.027259] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.027348] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.027597] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.027698] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.027853] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.027904] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.027981] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.028083] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: def9aa42-470d-498e-9034-6879fb1e6ebc is going to be updated. [ 1249.087086] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.087327] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.087327] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.087501] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.087645] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.101513] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: def9aa42-470d-498e-9034-6879fb1e6ebc in Status: IN_PROGRESS for 2s [ 1249.306644] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-883 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.306858] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-883" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.307018] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-883" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.307309] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-883" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.307576] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.307742] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.307863] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.308271] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.308506] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.308749] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1249.308915] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1249.309103] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1249.309163] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1249.309282] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1249.309391] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1249.309527] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1249.328273] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1249.328444] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1249.328581] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1249.328753] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-883" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.329416] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-a813a46d-1c96-4a19-8706-a37a0e70d990 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.329611] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-a813a46d-1c96-4a19-8706-a37a0e70d990" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.329736] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-a813a46d-1c96-4a19-8706-a37a0e70d990" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.330093] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-a813a46d-1c96-4a19-8706-a37a0e70d990" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.330239] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a813a46d-1c96-4a19-8706-a37a0e70d990',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.339954] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.340106] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.340171] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.340368] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.340457] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.340551] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 is going to be updated. [ 1249.371378] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.371668] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.371668] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.371805] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.372014] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.380796] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 in Status: IN_PROGRESS for 2s [ 1249.832751] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.832994] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.833128] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.833424] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.834010] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.834010] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.834168] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.834207] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.834448] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.834605] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.834894] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.835071] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.835195] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.835424] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.835564] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.835710] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: a813a46d-1c96-4a19-8706-a37a0e70d990 is going to be updated. [ 1249.859023] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.859476] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.859476] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.859664] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.859871] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.860133] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-a813a46d-1c96-4a19-8706-a37a0e70d990" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.606747] env[70614]: INFO networking_nsxv3.common.synchronization [req-7d77eb61-7af1-43ce-8ccf-3b381f71ad3e req-b6d14509-eaf7-4106-80f7-a3058b62a2d9 service nova] Enqueued Resource ID: 4e54f39e-349d-49ad-bb07-348488d846f0 with Priority: HIGHEST for action security_group_rules [ 1250.606920] env[70614]: INFO networking_nsxv3.common.synchronization [req-7d77eb61-7af1-43ce-8ccf-3b381f71ad3e req-b6d14509-eaf7-4106-80f7-a3058b62a2d9 service nova] Enqueued Resource ID: 4e54f39e-349d-49ad-bb07-348488d846f0 with Priority: HIGHEST for action security_group_members [ 1250.607104] env[70614]: INFO networking_nsxv3.common.synchronization [req-7d77eb61-7af1-43ce-8ccf-3b381f71ad3e req-b6d14509-eaf7-4106-80f7-a3058b62a2d9 service nova] Enqueued Resource ID: a813a46d-1c96-4a19-8706-a37a0e70d990 with Priority: HIGHEST for action port [ 1250.607691] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e54f39e-349d-49ad-bb07-348488d846f0 with Priority: HIGHEST for action security_group_rules [ 1250.607867] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e54f39e-349d-49ad-bb07-348488d846f0 with Priority: HIGHEST for action security_group_members [ 1250.607975] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a813a46d-1c96-4a19-8706-a37a0e70d990 with Priority: HIGHEST for action port [ 1250.608569] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e54f39e-349d-49ad-bb07-348488d846f0 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.608706] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.608807] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.609116] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.609243] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e54f39e-349d-49ad-bb07-348488d846f0',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.610641] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e54f39e-349d-49ad-bb07-348488d846f0 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.611190] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.611261] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.611472] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.611632] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.612205] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.612302] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.612544] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.612544] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.612631] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e54f39e-349d-49ad-bb07-348488d846f0',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.613693] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-a813a46d-1c96-4a19-8706-a37a0e70d990 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.613809] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a813a46d-1c96-4a19-8706-a37a0e70d990" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.613873] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a813a46d-1c96-4a19-8706-a37a0e70d990" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.614021] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a813a46d-1c96-4a19-8706-a37a0e70d990" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.614201] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a813a46d-1c96-4a19-8706-a37a0e70d990',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.112314] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e54f39e-349d-49ad-bb07-348488d846f0 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.112834] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.116138] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4e54f39e-349d-49ad-bb07-348488d846f0',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.117232] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a813a46d-1c96-4a19-8706-a37a0e70d990 with status ACTIVE [ 1251.118030] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.118030] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.118030] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.118030] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.118318] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.118318] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.118391] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.118434] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.118586] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.118660] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.118853] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.118951] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.119031] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.119156] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.119335] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.119335] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a813a46d-1c96-4a19-8706-a37a0e70d990 is going to be updated. [ 1251.121123] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: def9aa42-470d-498e-9034-6879fb1e6ebc in Status: SUCCESS [ 1251.121345] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.149491] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.149750] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.149750] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.149976] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.150065] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.150233] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a813a46d-1c96-4a19-8706-a37a0e70d990" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.392495] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 in Status: SUCCESS [ 1251.392706] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.392832] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.393031] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.393274] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.393460] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.393460] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.393620] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.393702] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.393789] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.393883] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.623563] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4e54f39e-349d-49ad-bb07-348488d846f0',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.895828] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-76d591d6-9294-4288-b5c9-f6b7e2b45562 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.895996] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.896076] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.896285] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.896452] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.896567] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.896604] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.896764] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.896835] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.896931] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.897369] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-76d591d6-9294-4288-b5c9-f6b7e2b45562 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.897369] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.897369] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.897369] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.897616] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.897616] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.897616] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.897764] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.897856] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.897959] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.898143] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.127831] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.127831] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.127831] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.127831] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.127831] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.127831] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e54f39e-349d-49ad-bb07-348488d846f0 is going to be updated. [ 1252.152183] env[70614]: INFO networking_nsxv3.common.synchronization [req-766e43f6-9b4b-4e7a-9335-2f5330ab4f63 req-26a559a9-2ee7-4beb-ab67-c9c25ab6656a tempest-ServerDiskConfigTestJSON-2045015546 tempest-ServerDiskConfigTestJSON-2045015546-project-member] Enqueued Resource ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 with Priority: HIGHEST for action security_group_members [ 1252.153159] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 with Priority: HIGHEST for action security_group_members [ 1252.153969] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.157674] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.157674] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.157674] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.157674] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.157674] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.157674] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.157674] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.157674] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.157674] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94eb8a38-d1bf-4747-a73b-c4d0ea236bc3',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.163299] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.163299] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.163299] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.163299] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.163299] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.172016] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e54f39e-349d-49ad-bb07-348488d846f0 in Status: IN_PROGRESS for 2s [ 1252.400244] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 76d591d6-9294-4288-b5c9-f6b7e2b45562: rpc.has_security_group_logging(os_id): False [ 1252.420336] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.420842] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.421153] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.421493] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.421710] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.422055] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.422331] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.422515] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.422802] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.423051] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.423404] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.424079] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.424079] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.424079] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.424079] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.424457] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.424713] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.424895] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.425184] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.425503] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.425789] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 is going to be updated. [ 1252.492503] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.492503] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.492503] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.492503] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.492503] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.508947] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 in Status: IN_PROGRESS for 2s [ 1252.666020] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.666020] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.666020] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.666020] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.666020] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.666020] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.666020] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.666020] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.666020] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.666020] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.666020] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 is going to be updated. [ 1252.703024] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.703024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.703024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.703024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.703024] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.713942] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 in Status: IN_PROGRESS for 2s [ 1253.363456] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-498 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.363771] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-498" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.363813] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-498" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.364084] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-498" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.364350] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.364507] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.364627] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.364860] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.364992] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.365218] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1253.365334] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1253.365445] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1253.365558] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1253.365664] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1253.365769] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1253.365901] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1253.384163] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1253.384317] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1253.384460] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1253.384636] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-498" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.384939] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-73f2b52c-7270-4269-a217-a21bbd2bd666 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.385126] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-73f2b52c-7270-4269-a217-a21bbd2bd666" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.385250] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-73f2b52c-7270-4269-a217-a21bbd2bd666" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.385579] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-73f2b52c-7270-4269-a217-a21bbd2bd666" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.385721] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73f2b52c-7270-4269-a217-a21bbd2bd666',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.888468] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.888757] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.888941] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.889313] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.889522] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.889701] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 73f2b52c-7270-4269-a217-a21bbd2bd666 not found, creating... [ 1253.890706] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.890706] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.890706] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.890706] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.890949] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.891144] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.891352] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.891496] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.891769] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.891946] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.892111] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 73f2b52c-7270-4269-a217-a21bbd2bd666 is going to be created. [ 1253.912601] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.912824] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.913993] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.913993] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.913993] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.913993] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-73f2b52c-7270-4269-a217-a21bbd2bd666" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.271116] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e54f39e-349d-49ad-bb07-348488d846f0 in Status: SUCCESS [ 1254.271116] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.271116] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.271116] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.271116] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.271116] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.271116] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.271116] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.271116] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.271116] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.271116] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4e54f39e-349d-49ad-bb07-348488d846f0',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.525967] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 in Status: SUCCESS [ 1254.526253] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.663123] env[70614]: INFO networking_nsxv3.common.synchronization [req-766e43f6-9b4b-4e7a-9335-2f5330ab4f63 req-effac077-db75-4867-a64d-1713542007ad service nova] Enqueued Resource ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 with Priority: HIGHEST for action security_group_rules [ 1254.663394] env[70614]: INFO networking_nsxv3.common.synchronization [req-766e43f6-9b4b-4e7a-9335-2f5330ab4f63 req-effac077-db75-4867-a64d-1713542007ad service nova] Enqueued Resource ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 with Priority: HIGHEST for action security_group_members [ 1254.663474] env[70614]: INFO networking_nsxv3.common.synchronization [req-766e43f6-9b4b-4e7a-9335-2f5330ab4f63 req-effac077-db75-4867-a64d-1713542007ad service nova] Enqueued Resource ID: 73f2b52c-7270-4269-a217-a21bbd2bd666 with Priority: HIGHEST for action port [ 1254.663742] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 with Priority: HIGHEST for action security_group_rules [ 1254.663878] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 with Priority: HIGHEST for action security_group_members [ 1254.663972] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73f2b52c-7270-4269-a217-a21bbd2bd666 with Priority: HIGHEST for action port [ 1254.664549] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.664675] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.664743] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.664953] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.665245] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('94eb8a38-d1bf-4747-a73b-c4d0ea236bc3',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.666591] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.666737] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.666975] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-73f2b52c-7270-4269-a217-a21bbd2bd666 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.667167] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-73f2b52c-7270-4269-a217-a21bbd2bd666" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.667243] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-73f2b52c-7270-4269-a217-a21bbd2bd666" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.667455] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-73f2b52c-7270-4269-a217-a21bbd2bd666" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.667581] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73f2b52c-7270-4269-a217-a21bbd2bd666',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.723995] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 in Status: SUCCESS [ 1254.724189] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 deletion is rescheduled due to dependency. [ 1254.724357] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.724526] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.724743] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.724968] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.725120] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.725186] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.725340] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.725423] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.725519] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94eb8a38-d1bf-4747-a73b-c4d0ea236bc3',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.775205] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4e54f39e-349d-49ad-bb07-348488d846f0',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.169678] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.171092] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.171092] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 73f2b52c-7270-4269-a217-a21bbd2bd666 with status ACTIVE [ 1255.171092] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.171092] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.171092] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.171092] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.171092] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.171558] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.171558] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.171558] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.171558] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.171696] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.171975] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.171975] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.171975] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.172172] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.172291] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.172400] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 73f2b52c-7270-4269-a217-a21bbd2bd666 is going to be updated. [ 1255.193989] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.194189] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.194232] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.194436] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.194573] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.194728] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-73f2b52c-7270-4269-a217-a21bbd2bd666" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.227347] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('94eb8a38-d1bf-4747-a73b-c4d0ea236bc3',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.278142] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4e54f39e-349d-49ad-bb07-348488d846f0: rpc.has_security_group_logging(os_id): False [ 1255.304320] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.304509] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.304553] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.304772] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.304854] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.305154] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.305284] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.305339] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.305478] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.305552] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.305638] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e54f39e-349d-49ad-bb07-348488d846f0 is going to be updated. [ 1255.398558] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.398838] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.398838] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.399092] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.399237] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.423843] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e54f39e-349d-49ad-bb07-348488d846f0 in Status: IN_PROGRESS for 2s [ 1255.730943] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('94eb8a38-d1bf-4747-a73b-c4d0ea236bc3',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.236993] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.237264] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.237264] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.237656] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.237796] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.237964] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 is going to be updated. [ 1256.276575] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.276867] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.276867] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.277180] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.277379] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.286912] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 in Status: IN_PROGRESS for 2s [ 1256.761435] env[70614]: INFO networking_nsxv3.common.synchronization [req-922eb7f3-04d4-463b-b121-5ab3bac04368 req-06564292-d54a-4535-8392-e8eb3516b0ef tempest-ServersTestJSON-1535400473 tempest-ServersTestJSON-1535400473-project-member] Enqueued Resource ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 with Priority: HIGHEST for action security_group_members [ 1256.762865] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 with Priority: HIGHEST for action security_group_members [ 1256.763284] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-76d591d6-9294-4288-b5c9-f6b7e2b45562 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.763426] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.763495] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.763756] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.763926] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.764057] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.764124] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.764280] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.764370] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.764464] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.266969] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.441685] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e54f39e-349d-49ad-bb07-348488d846f0 in Status: SUCCESS [ 1257.441685] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.769681] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.272860] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.273118] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.273118] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.273497] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.273612] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.273733] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 is going to be updated. [ 1258.296100] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 in Status: SUCCESS [ 1258.296337] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.296524] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.296749] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.296953] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.297097] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.297156] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.297328] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.297411] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.297493] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.297602] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('94eb8a38-d1bf-4747-a73b-c4d0ea236bc3',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.306643] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.306818] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.306884] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.307074] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.307222] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.318499] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 in Status: IN_PROGRESS for 2s [ 1258.800365] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.800739] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.800739] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.800921] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.801573] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.801573] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.801573] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.801573] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.801825] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.801825] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.801989] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.802120] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.802885] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.802885] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.802885] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.802885] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.802885] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.802885] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.802885] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.803201] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.803201] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('94eb8a38-d1bf-4747-a73b-c4d0ea236bc3',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.305567] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3: rpc.has_security_group_logging(os_id): False [ 1259.323482] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.323699] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.323776] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.324017] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.324129] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.324328] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.324422] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.324476] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.324635] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.324797] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.324901] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.325011] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.325130] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.325322] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.325360] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.325533] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.325623] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.325689] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.325823] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.325965] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.326101] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 is going to be updated. [ 1259.385255] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.385460] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.385460] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.385661] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.385808] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.400232] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 in Status: IN_PROGRESS for 2s [ 1260.329312] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 in Status: SUCCESS [ 1260.329779] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.423634] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 in Status: SUCCESS [ 1261.424164] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.634622] env[70614]: INFO networking_nsxv3.common.synchronization [req-ae747ee8-a4b7-4458-ba2f-2a0e2ed1e6f3 req-1a8f925a-d5ae-442d-b44e-85e14b789f37 tempest-ServerRescueNegativeTestJSON-1616269448 tempest-ServerRescueNegativeTestJSON-1616269448-project-member] Enqueued Resource ID: 9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1 with Priority: HIGHEST for action security_group_members [ 1261.635136] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1 with Priority: HIGHEST for action security_group_members [ 1261.635458] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.635583] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.635652] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.635860] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.636094] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.636205] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.636266] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.636781] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.636781] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.636781] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.138550] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.641857] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.144686] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.144943] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.144943] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.145465] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.145629] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.145772] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1 is going to be updated. [ 1263.178893] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.179205] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.179385] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.179775] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.180071] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.190317] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1 in Status: IN_PROGRESS for 2s [ 1265.203761] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1 in Status: SUCCESS [ 1265.203761] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.251763] env[70614]: INFO networking_nsxv3.common.synchronization [req-f6039724-c8b8-4956-8d44-ac5c39585fd2 req-d5a267fd-b0aa-48b8-8522-2c586363c616 tempest-ServersTestJSON-1535400473 tempest-ServersTestJSON-1535400473-project-member] Enqueued Resource ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 with Priority: HIGHEST for action security_group_members [ 1266.252478] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 with Priority: HIGHEST for action security_group_members [ 1266.252808] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-76d591d6-9294-4288-b5c9-f6b7e2b45562 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.253390] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.253390] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.253995] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.254412] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.254552] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.254874] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.254874] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.254874] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.254966] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.567994] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-146 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.568247] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-146" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.568407] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-146" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.568654] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-146" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.568920] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.569140] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.569281] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.569503] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.569696] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.569923] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1266.570053] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1266.570170] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1266.570283] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1266.570399] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1266.570511] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1266.570645] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1266.591913] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1266.592121] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1266.592238] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1266.592422] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-146" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.592733] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-0a54feec-9c4b-4376-9a2a-5f2e95094d58 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.592907] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-0a54feec-9c4b-4376-9a2a-5f2e95094d58" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.593045] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-0a54feec-9c4b-4376-9a2a-5f2e95094d58" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.593427] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-0a54feec-9c4b-4376-9a2a-5f2e95094d58" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.593574] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a54feec-9c4b-4376-9a2a-5f2e95094d58',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.757803] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.095758] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.095968] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.096065] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.096853] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.096853] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.096853] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 0a54feec-9c4b-4376-9a2a-5f2e95094d58 not found, creating... [ 1267.097061] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.097130] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.097208] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.097427] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.097564] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.097854] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.098015] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.098136] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.098343] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.098476] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.098617] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 0a54feec-9c4b-4376-9a2a-5f2e95094d58 is going to be created. [ 1267.119380] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.119617] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.119749] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.120523] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.120632] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.120858] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-0a54feec-9c4b-4376-9a2a-5f2e95094d58" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.259932] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.763763] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.763962] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.763962] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.764182] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.764274] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.764378] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 is going to be updated. [ 1267.796177] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.796325] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.796410] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.796624] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.796896] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.800168] env[70614]: INFO networking_nsxv3.common.synchronization [req-f6039724-c8b8-4956-8d44-ac5c39585fd2 req-60e334fd-6207-41ec-9ae1-bd012d9bc559 service nova] Enqueued Resource ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 with Priority: HIGHEST for action security_group_rules [ 1267.800430] env[70614]: INFO networking_nsxv3.common.synchronization [req-f6039724-c8b8-4956-8d44-ac5c39585fd2 req-60e334fd-6207-41ec-9ae1-bd012d9bc559 service nova] Enqueued Resource ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 with Priority: HIGHEST for action security_group_members [ 1267.800600] env[70614]: INFO networking_nsxv3.common.synchronization [req-f6039724-c8b8-4956-8d44-ac5c39585fd2 req-60e334fd-6207-41ec-9ae1-bd012d9bc559 service nova] Enqueued Resource ID: 0a54feec-9c4b-4376-9a2a-5f2e95094d58 with Priority: HIGHEST for action port [ 1267.800813] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 with Priority: HIGHEST for action security_group_rules [ 1267.801171] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 with Priority: HIGHEST for action security_group_members [ 1267.801300] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a54feec-9c4b-4376-9a2a-5f2e95094d58 with Priority: HIGHEST for action port [ 1267.801868] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-76d591d6-9294-4288-b5c9-f6b7e2b45562 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.802116] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.802116] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.802344] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.802431] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.803652] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-76d591d6-9294-4288-b5c9-f6b7e2b45562 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.803757] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.803940] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-0a54feec-9c4b-4376-9a2a-5f2e95094d58 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.804115] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0a54feec-9c4b-4376-9a2a-5f2e95094d58" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.804212] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0a54feec-9c4b-4376-9a2a-5f2e95094d58" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.804358] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0a54feec-9c4b-4376-9a2a-5f2e95094d58" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.804418] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a54feec-9c4b-4376-9a2a-5f2e95094d58',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.808585] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 in Status: IN_PROGRESS for 2s [ 1268.138451] env[70614]: INFO networking_nsxv3.common.synchronization [req-997d559b-f71c-48ac-ba15-2fd9df822bef req-12bad979-62e1-488f-b664-41bfc8968cf5 tempest-ServerDiskConfigTestJSON-2045015546 tempest-ServerDiskConfigTestJSON-2045015546-project-member] Enqueued Resource ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 with Priority: HIGHEST for action security_group_members [ 1268.139061] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 with Priority: HIGHEST for action security_group_members [ 1268.139851] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.140025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.140130] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.140353] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.140512] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.140618] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.140678] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.140824] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.140908] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.141033] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94eb8a38-d1bf-4747-a73b-c4d0ea236bc3',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.306540] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-76d591d6-9294-4288-b5c9-f6b7e2b45562 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.306963] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.306963] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0a54feec-9c4b-4376-9a2a-5f2e95094d58 with status ACTIVE [ 1268.307075] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.307292] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.307292] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.307903] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.307903] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.307903] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.307903] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.308125] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.308125] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.308223] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.308376] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.308473] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.308534] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.308701] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.308778] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.308864] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0a54feec-9c4b-4376-9a2a-5f2e95094d58 is going to be updated. [ 1268.330833] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.330990] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.331150] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.331334] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.331472] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.331632] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0a54feec-9c4b-4376-9a2a-5f2e95094d58" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.642902] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.643226] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.643226] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.643427] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.643540] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.643747] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.643845] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.643905] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.644085] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.644167] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.644303] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 is going to be updated. [ 1268.675665] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.675877] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.675877] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.676125] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.677084] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.687509] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 in Status: IN_PROGRESS for 2s [ 1269.791265] env[70614]: INFO networking_nsxv3.common.synchronization [req-bd05f05a-9e20-4748-b82f-a09c3f3e87d0 req-d4c23a86-0120-45d1-8386-cf542cd81a37 tempest-ServerActionsTestOtherB-1079543702 tempest-ServerActionsTestOtherB-1079543702-project-member] Enqueued Resource ID: 4e54f39e-349d-49ad-bb07-348488d846f0 with Priority: HIGHEST for action security_group_members [ 1269.791500] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e54f39e-349d-49ad-bb07-348488d846f0 with Priority: HIGHEST for action security_group_members [ 1269.791645] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e54f39e-349d-49ad-bb07-348488d846f0 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.791732] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.791865] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.792029] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.792206] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.792348] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.792407] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.792540] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.792645] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.792766] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e54f39e-349d-49ad-bb07-348488d846f0',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.819807] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 in Status: SUCCESS [ 1269.820049] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.820570] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.820799] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.821149] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.821149] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.821265] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.821422] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.821520] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.821636] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.187159] env[70614]: INFO networking_nsxv3.common.synchronization [req-e0e6d0cf-20d9-4405-8c11-6e6d1cbc7896 req-f7002e74-3dc6-4a5e-8f33-51d83d9bb6a1 tempest-ServerRescueNegativeTestJSON-1616269448 tempest-ServerRescueNegativeTestJSON-1616269448-project-member] Enqueued Resource ID: 9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1 with Priority: HIGHEST for action security_group_members [ 1270.187918] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1 with Priority: HIGHEST for action security_group_members [ 1270.188053] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.188180] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.188253] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.188451] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.188602] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.188691] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.189138] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.189138] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.189138] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.189138] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.295482] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.295652] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.295720] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.295940] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.296042] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.296373] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.296503] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.296569] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.296683] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.296749] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.296878] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e54f39e-349d-49ad-bb07-348488d846f0 is going to be updated. [ 1270.323680] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.325499] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.325633] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.325687] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.325933] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.326098] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.335472] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e54f39e-349d-49ad-bb07-348488d846f0 in Status: IN_PROGRESS for 2s [ 1270.691606] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.692409] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.692409] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.692409] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.701564] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 in Status: SUCCESS [ 1270.701674] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94eb8a38-d1bf-4747-a73b-c4d0ea236bc3 deletion is rescheduled due to dependency. [ 1270.701726] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94eb8a38-d1bf-4747-a73b-c4d0ea236bc3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.712488] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.713691] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.713691] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.713691] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.713691] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.713691] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.713691] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1 is going to be updated. [ 1270.740962] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.740962] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.741233] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.741355] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.741562] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.750061] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1 in Status: IN_PROGRESS for 2s [ 1270.828245] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.330170] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.330412] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.330510] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.330807] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.330944] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.331121] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 is going to be updated. [ 1271.363021] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.363021] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.363021] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.363225] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.363285] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.373835] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 in Status: IN_PROGRESS for 2s [ 1272.345810] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e54f39e-349d-49ad-bb07-348488d846f0 in Status: SUCCESS [ 1272.346092] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e54f39e-349d-49ad-bb07-348488d846f0 deletion is rescheduled due to dependency. [ 1272.346092] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.760599] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1 in Status: SUCCESS [ 1272.760899] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1 deletion is rescheduled due to dependency. [ 1272.761215] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.385187] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 in Status: SUCCESS [ 1273.385187] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.385187] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.385187] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.385694] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.385694] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.385694] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.385694] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.385694] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.385891] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.385891] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.887765] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-76d591d6-9294-4288-b5c9-f6b7e2b45562 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.887956] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.888079] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.888318] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.888484] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.888590] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.888656] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.888828] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.888922] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.889040] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.889196] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-76d591d6-9294-4288-b5c9-f6b7e2b45562 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.889338] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.889406] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.889573] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.889740] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.889860] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.889890] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.890040] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.890926] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.890926] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.890926] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.392820] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 76d591d6-9294-4288-b5c9-f6b7e2b45562: rpc.has_security_group_logging(os_id): False [ 1274.410465] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.410864] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.411065] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.411382] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.411575] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.413017] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.413017] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.413017] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.413017] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.413017] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.413017] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.413017] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.413017] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.413017] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.413017] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.413461] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.413701] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.413874] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.414104] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.414323] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.414481] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 is going to be updated. [ 1274.473042] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.473205] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.473277] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.473501] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.473648] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.500836] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 in Status: IN_PROGRESS for 2s [ 1275.189058] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1275.189058] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1276.251253] env[70614]: INFO networking_nsxv3.common.synchronization [None req-b3f3236e-7042-4a9a-81db-bd0eed85b474 None None] Enqueued Resource ID: 800b336e-e5da-405f-ba5e-875dabedb49d with Priority: HIGHEST for action port [ 1276.251253] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 800b336e-e5da-405f-ba5e-875dabedb49d with Priority: HIGHEST for action port [ 1276.251253] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-800b336e-e5da-405f-ba5e-875dabedb49d taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.251253] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-800b336e-e5da-405f-ba5e-875dabedb49d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.251253] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-800b336e-e5da-405f-ba5e-875dabedb49d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.251253] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-800b336e-e5da-405f-ba5e-875dabedb49d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.251253] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('800b336e-e5da-405f-ba5e-875dabedb49d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.525448] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 in Status: SUCCESS [ 1276.525448] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.757481] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 800b336e-e5da-405f-ba5e-875dabedb49d [ 1276.757762] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.757762] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.757920] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.758018] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.758297] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.758297] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:800b336e-e5da-405f-ba5e-875dabedb49d already deleted. [ 1276.758297] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-800b336e-e5da-405f-ba5e-875dabedb49d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.559228] env[70614]: INFO networking_nsxv3.common.synchronization [None req-45c0bc0b-8091-4a5f-93e0-ec8f1113e4f7 None None] Enqueued Resource ID: b90abf2b-5f35-451b-be19-eb287f94ae02 with Priority: HIGHEST for action port [ 1278.559519] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b90abf2b-5f35-451b-be19-eb287f94ae02 with Priority: HIGHEST for action port [ 1278.560155] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-b90abf2b-5f35-451b-be19-eb287f94ae02 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.560291] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b90abf2b-5f35-451b-be19-eb287f94ae02" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.562449] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b90abf2b-5f35-451b-be19-eb287f94ae02" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.562757] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b90abf2b-5f35-451b-be19-eb287f94ae02" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.562859] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b90abf2b-5f35-451b-be19-eb287f94ae02',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.064953] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b90abf2b-5f35-451b-be19-eb287f94ae02 [ 1279.065197] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.065315] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.065386] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.065591] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.065678] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.065774] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b90abf2b-5f35-451b-be19-eb287f94ae02 already deleted. [ 1279.065855] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b90abf2b-5f35-451b-be19-eb287f94ae02" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.163295] env[70614]: INFO networking_nsxv3.common.synchronization [req-b527a833-694f-4527-92fe-8442dd6d73bb req-327a69b9-d43b-479c-828a-707765f1753d tempest-ServersTestJSON-1535400473 tempest-ServersTestJSON-1535400473-project-member] Enqueued Resource ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 with Priority: HIGHEST for action security_group_members [ 1281.163921] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 with Priority: HIGHEST for action security_group_members [ 1281.164220] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-76d591d6-9294-4288-b5c9-f6b7e2b45562 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.164335] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.164401] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.164589] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.164731] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.164818] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.164875] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.165019] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.165117] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.165227] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.666869] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.097768] env[70614]: INFO networking_nsxv3.common.synchronization [req-f6724afd-a08b-4057-9e51-6102f5bb859e req-738b789c-41f7-4324-a24b-ac249916edfd tempest-InstanceActionsTestJSON-1066227025 tempest-InstanceActionsTestJSON-1066227025-project-member] Enqueued Resource ID: ca853b04-ee44-46f5-a78c-096d9284c247 with Priority: HIGHEST for action security_group_members [ 1282.098292] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca853b04-ee44-46f5-a78c-096d9284c247 with Priority: HIGHEST for action security_group_members [ 1282.098580] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca853b04-ee44-46f5-a78c-096d9284c247 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.098699] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca853b04-ee44-46f5-a78c-096d9284c247" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.098760] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca853b04-ee44-46f5-a78c-096d9284c247" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.099033] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca853b04-ee44-46f5-a78c-096d9284c247" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.099195] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.099297] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.099357] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.100142] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.100142] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.100142] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca853b04-ee44-46f5-a78c-096d9284c247',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.168932] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.355184] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-541 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.355836] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-541" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.355836] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-541" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.355836] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-541" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.356121] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.356291] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.356415] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.356639] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.356786] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.357010] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1282.357136] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1282.357253] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1282.357368] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1282.357481] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1282.357590] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1282.357724] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1282.378399] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1282.378642] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1282.378719] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1282.378900] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-541" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.379302] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-9cb5b476-5249-4c35-999f-013dfb66d3a3 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.379486] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-9cb5b476-5249-4c35-999f-013dfb66d3a3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.379612] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-9cb5b476-5249-4c35-999f-013dfb66d3a3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.379932] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-9cb5b476-5249-4c35-999f-013dfb66d3a3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.380086] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9cb5b476-5249-4c35-999f-013dfb66d3a3',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.601999] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.602238] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.602343] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.602596] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.602715] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.602940] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.603109] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.603196] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.603357] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.603459] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.603524] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca853b04-ee44-46f5-a78c-096d9284c247 already deleted. [ 1282.603599] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca853b04-ee44-46f5-a78c-096d9284c247" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.672437] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.673053] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.673157] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.673376] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.673468] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.673570] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 is going to be updated. [ 1282.700130] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.700331] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.700431] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.700619] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.700772] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.711224] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 in Status: IN_PROGRESS for 2s [ 1282.882645] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.882645] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.882645] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.882914] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.883067] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.883215] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 9cb5b476-5249-4c35-999f-013dfb66d3a3 not found, creating... [ 1282.883491] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.883842] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.883842] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.883992] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.884139] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.884428] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.884587] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.884707] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.884919] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.885083] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.885348] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 9cb5b476-5249-4c35-999f-013dfb66d3a3 is going to be created. [ 1282.904097] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.904370] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.904511] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.904783] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.905033] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.905269] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-9cb5b476-5249-4c35-999f-013dfb66d3a3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.586037] env[70614]: INFO networking_nsxv3.common.synchronization [req-f6724afd-a08b-4057-9e51-6102f5bb859e req-3ac21f19-3ce4-463a-a6e9-068faa0800da service nova] Enqueued Resource ID: ca853b04-ee44-46f5-a78c-096d9284c247 with Priority: HIGHEST for action security_group_rules [ 1283.586276] env[70614]: INFO networking_nsxv3.common.synchronization [req-f6724afd-a08b-4057-9e51-6102f5bb859e req-3ac21f19-3ce4-463a-a6e9-068faa0800da service nova] Enqueued Resource ID: ca853b04-ee44-46f5-a78c-096d9284c247 with Priority: HIGHEST for action security_group_members [ 1283.586354] env[70614]: INFO networking_nsxv3.common.synchronization [req-f6724afd-a08b-4057-9e51-6102f5bb859e req-3ac21f19-3ce4-463a-a6e9-068faa0800da service nova] Enqueued Resource ID: 9cb5b476-5249-4c35-999f-013dfb66d3a3 with Priority: HIGHEST for action port [ 1283.586558] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca853b04-ee44-46f5-a78c-096d9284c247 with Priority: HIGHEST for action security_group_rules [ 1283.586686] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca853b04-ee44-46f5-a78c-096d9284c247 with Priority: HIGHEST for action security_group_members [ 1283.586781] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cb5b476-5249-4c35-999f-013dfb66d3a3 with Priority: HIGHEST for action port [ 1283.587345] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca853b04-ee44-46f5-a78c-096d9284c247 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.587526] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca853b04-ee44-46f5-a78c-096d9284c247" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.587666] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca853b04-ee44-46f5-a78c-096d9284c247" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.587896] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca853b04-ee44-46f5-a78c-096d9284c247" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.587982] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca853b04-ee44-46f5-a78c-096d9284c247',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.588821] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca853b04-ee44-46f5-a78c-096d9284c247 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.592020] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca853b04-ee44-46f5-a78c-096d9284c247" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.592020] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca853b04-ee44-46f5-a78c-096d9284c247" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.592020] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca853b04-ee44-46f5-a78c-096d9284c247" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.592020] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.592020] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.592020] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.592020] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.592020] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.592020] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca853b04-ee44-46f5-a78c-096d9284c247',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.592020] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-9cb5b476-5249-4c35-999f-013dfb66d3a3 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.592020] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9cb5b476-5249-4c35-999f-013dfb66d3a3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.592020] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9cb5b476-5249-4c35-999f-013dfb66d3a3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.592020] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9cb5b476-5249-4c35-999f-013dfb66d3a3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.592020] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9cb5b476-5249-4c35-999f-013dfb66d3a3',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.093620] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca853b04-ee44-46f5-a78c-096d9284c247 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.093832] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca853b04-ee44-46f5-a78c-096d9284c247" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.093972] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca853b04-ee44-46f5-a78c-096d9284c247',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.095015] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9cb5b476-5249-4c35-999f-013dfb66d3a3 with status ACTIVE [ 1284.095222] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.095343] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.095411] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.095618] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.095707] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.095874] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.095970] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.096046] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.096202] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.096279] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.096457] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.096548] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.096607] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.096740] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.096811] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.096894] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9cb5b476-5249-4c35-999f-013dfb66d3a3 is going to be updated. [ 1284.118848] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.119095] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.119095] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.119266] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.119402] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.119560] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9cb5b476-5249-4c35-999f-013dfb66d3a3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.599473] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca853b04-ee44-46f5-a78c-096d9284c247',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.720957] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 in Status: SUCCESS [ 1284.721233] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.102891] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.103085] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.103130] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.103381] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.103492] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.103603] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca853b04-ee44-46f5-a78c-096d9284c247 is going to be created. [ 1285.126658] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.126883] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.126960] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.127255] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.127419] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.136760] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca853b04-ee44-46f5-a78c-096d9284c247 in Status: UNINITIALIZED for 2s [ 1287.149116] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca853b04-ee44-46f5-a78c-096d9284c247 in Status: SUCCESS [ 1287.149645] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca853b04-ee44-46f5-a78c-096d9284c247" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.149817] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca853b04-ee44-46f5-a78c-096d9284c247" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.150149] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca853b04-ee44-46f5-a78c-096d9284c247" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.150454] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.150649] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.150739] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.150971] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.151108] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.151331] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca853b04-ee44-46f5-a78c-096d9284c247" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.151475] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ca853b04-ee44-46f5-a78c-096d9284c247',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1287.654851] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca853b04-ee44-46f5-a78c-096d9284c247 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.655106] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca853b04-ee44-46f5-a78c-096d9284c247" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.655106] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca853b04-ee44-46f5-a78c-096d9284c247" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.655267] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca853b04-ee44-46f5-a78c-096d9284c247" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.655435] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.655538] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.655602] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.655753] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.655840] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.655928] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca853b04-ee44-46f5-a78c-096d9284c247" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.656099] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca853b04-ee44-46f5-a78c-096d9284c247 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.656205] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca853b04-ee44-46f5-a78c-096d9284c247" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.656267] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca853b04-ee44-46f5-a78c-096d9284c247" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.656409] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca853b04-ee44-46f5-a78c-096d9284c247" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.656543] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.656636] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.656697] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.656829] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.656902] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.656982] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca853b04-ee44-46f5-a78c-096d9284c247" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.657092] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ca853b04-ee44-46f5-a78c-096d9284c247',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.159828] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ca853b04-ee44-46f5-a78c-096d9284c247: rpc.has_security_group_logging(os_id): False [ 1288.180670] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.180935] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.181122] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.181411] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.181555] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.181848] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.182019] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.182124] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.182376] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.182509] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.182825] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.182986] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.183189] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.183325] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.183448] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.183741] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.183897] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.184010] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.184255] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.184400] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.184535] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca853b04-ee44-46f5-a78c-096d9284c247 is going to be created. [ 1288.239069] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.239319] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.239319] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.239550] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.239750] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.249719] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca853b04-ee44-46f5-a78c-096d9284c247 in Status: IN_PROGRESS for 2s [ 1288.587939] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1288.588077] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1288.598682] env[70614]: INFO networking_nsxv3.common.synchronization [req-b2e2289a-9b66-43fd-bbeb-43259cf3d915 req-1afff4da-0e9d-4920-8f51-ae5e1b7ff4ce tempest-ServersTestJSON-1535400473 tempest-ServersTestJSON-1535400473-project-member] Enqueued Resource ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 with Priority: HIGHEST for action security_group_members [ 1288.599474] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 with Priority: HIGHEST for action security_group_members [ 1288.602222] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-76d591d6-9294-4288-b5c9-f6b7e2b45562 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.602222] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.602222] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.602222] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.602222] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.602222] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.602222] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.602222] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.602222] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.602222] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.105087] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.105300] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.105300] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.105531] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.105629] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.105872] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.105967] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.106019] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.106164] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.106244] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.106334] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 is going to be updated. [ 1289.138908] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.139196] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.139312] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.139618] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.139840] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.161753] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 in Status: IN_PROGRESS for 2s [ 1290.262876] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca853b04-ee44-46f5-a78c-096d9284c247 in Status: SUCCESS [ 1290.263304] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca853b04-ee44-46f5-a78c-096d9284c247" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.194738] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 in Status: SUCCESS [ 1291.194965] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 deletion is rescheduled due to dependency. [ 1291.195106] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.600681] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1293.600681] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1298.601579] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1298.601922] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1299.424839] env[70614]: INFO networking_nsxv3.common.synchronization [req-056d18a0-7761-4570-88c0-4ccbcc1ec244 req-bce2451c-bad8-4728-ae21-d5707c863660 tempest-InstanceActionsTestJSON-1066227025 tempest-InstanceActionsTestJSON-1066227025-project-member] Enqueued Resource ID: ca853b04-ee44-46f5-a78c-096d9284c247 with Priority: HIGHEST for action security_group_members [ 1299.425431] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca853b04-ee44-46f5-a78c-096d9284c247 with Priority: HIGHEST for action security_group_members [ 1299.425670] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca853b04-ee44-46f5-a78c-096d9284c247 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.426175] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca853b04-ee44-46f5-a78c-096d9284c247" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.426175] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca853b04-ee44-46f5-a78c-096d9284c247" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.426175] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca853b04-ee44-46f5-a78c-096d9284c247" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.426498] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.426498] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.426498] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.426987] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.426987] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.426987] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca853b04-ee44-46f5-a78c-096d9284c247',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.929061] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.929457] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.929457] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.929552] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.929652] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.929860] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.930048] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.930048] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.930222] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.930313] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.930429] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca853b04-ee44-46f5-a78c-096d9284c247 is going to be updated. [ 1299.975344] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.975552] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.975552] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.975773] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.975921] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.985772] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca853b04-ee44-46f5-a78c-096d9284c247 in Status: IN_PROGRESS for 2s [ 1300.876688] env[70614]: INFO networking_nsxv3.common.synchronization [req-394e25ae-da94-4dfc-b79f-f6745866a995 req-46c43f38-4bf5-4d21-a542-cdc1ccced7d0 tempest-ServerActionsTestOtherA-302418031 tempest-ServerActionsTestOtherA-302418031-project-member] Enqueued Resource ID: f58ad372-72ca-472a-aab5-8b86e9d2f1e6 with Priority: HIGHEST for action security_group_members [ 1300.877283] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f58ad372-72ca-472a-aab5-8b86e9d2f1e6 with Priority: HIGHEST for action security_group_members [ 1300.877574] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-f58ad372-72ca-472a-aab5-8b86e9d2f1e6 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.877695] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f58ad372-72ca-472a-aab5-8b86e9d2f1e6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.877756] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f58ad372-72ca-472a-aab5-8b86e9d2f1e6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.878047] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f58ad372-72ca-472a-aab5-8b86e9d2f1e6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.878118] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.878196] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.878260] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.878397] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.878492] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.878584] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f58ad372-72ca-472a-aab5-8b86e9d2f1e6',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.380698] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f58ad372-72ca-472a-aab5-8b86e9d2f1e6',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.883297] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f58ad372-72ca-472a-aab5-8b86e9d2f1e6',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.998418] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca853b04-ee44-46f5-a78c-096d9284c247 in Status: SUCCESS [ 1301.998628] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca853b04-ee44-46f5-a78c-096d9284c247 deletion is rescheduled due to dependency. [ 1301.998709] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca853b04-ee44-46f5-a78c-096d9284c247" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.386165] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.386486] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.386486] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.386630] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.386720] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.386819] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f58ad372-72ca-472a-aab5-8b86e9d2f1e6 is going to be updated. [ 1302.420096] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.420262] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.420342] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.420520] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.420689] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.431976] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f58ad372-72ca-472a-aab5-8b86e9d2f1e6 in Status: IN_PROGRESS for 2s [ 1303.508201] env[70614]: INFO networking_nsxv3.common.synchronization [None req-3e1519d3-1a3f-4526-91dc-e07ce183fb41 None None] Enqueued Resource ID: 561139c6-a781-4316-a588-306b8e0c1fef with Priority: HIGHEST for action port [ 1303.508201] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 561139c6-a781-4316-a588-306b8e0c1fef with Priority: HIGHEST for action port [ 1303.508201] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-561139c6-a781-4316-a588-306b8e0c1fef taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.508201] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-561139c6-a781-4316-a588-306b8e0c1fef" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.508201] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-561139c6-a781-4316-a588-306b8e0c1fef" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.508817] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-561139c6-a781-4316-a588-306b8e0c1fef" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.509114] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('561139c6-a781-4316-a588-306b8e0c1fef',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.013287] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 561139c6-a781-4316-a588-306b8e0c1fef [ 1304.013287] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.013287] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.013287] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.013287] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.013287] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.013287] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:561139c6-a781-4316-a588-306b8e0c1fef already deleted. [ 1304.013287] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-561139c6-a781-4316-a588-306b8e0c1fef" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.138044] env[70614]: INFO networking_nsxv3.common.synchronization [None req-3e77bea1-866b-43e8-96bf-1170c2050ae2 tempest-AttachVolumeShelveTestJSON-232337985 tempest-AttachVolumeShelveTestJSON-232337985-project-member] Enqueued Resource ID: b6d86fb6-2897-4e0b-8601-d87ed7fe208e with Priority: HIGHEST for action security_group_rules [ 1304.138044] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6d86fb6-2897-4e0b-8601-d87ed7fe208e with Priority: HIGHEST for action security_group_rules [ 1304.138044] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b6d86fb6-2897-4e0b-8601-d87ed7fe208e taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.138044] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b6d86fb6-2897-4e0b-8601-d87ed7fe208e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.138044] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b6d86fb6-2897-4e0b-8601-d87ed7fe208e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.138044] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b6d86fb6-2897-4e0b-8601-d87ed7fe208e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.138044] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b6d86fb6-2897-4e0b-8601-d87ed7fe208e',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.219257] env[70614]: INFO networking_nsxv3.common.synchronization [None req-5ddb4246-a0b4-4673-a1d1-2a6c9cff77cd tempest-AttachVolumeShelveTestJSON-232337985 tempest-AttachVolumeShelveTestJSON-232337985-project-member] Enqueued Resource ID: b6d86fb6-2897-4e0b-8601-d87ed7fe208e with Priority: HIGHEST for action security_group_rules [ 1304.219598] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6d86fb6-2897-4e0b-8601-d87ed7fe208e with Priority: HIGHEST for action security_group_rules [ 1304.219888] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b6d86fb6-2897-4e0b-8601-d87ed7fe208e taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.219993] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b6d86fb6-2897-4e0b-8601-d87ed7fe208e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.445343] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f58ad372-72ca-472a-aab5-8b86e9d2f1e6 in Status: SUCCESS [ 1304.445562] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f58ad372-72ca-472a-aab5-8b86e9d2f1e6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.663148] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.663148] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.663148] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.663148] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.663148] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.663148] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b6d86fb6-2897-4e0b-8601-d87ed7fe208e already deleted. [ 1304.663148] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b6d86fb6-2897-4e0b-8601-d87ed7fe208e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.663661] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b6d86fb6-2897-4e0b-8601-d87ed7fe208e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.663661] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b6d86fb6-2897-4e0b-8601-d87ed7fe208e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.663661] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b6d86fb6-2897-4e0b-8601-d87ed7fe208e',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.187061] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.187061] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.187061] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.187061] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.187061] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.187061] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b6d86fb6-2897-4e0b-8601-d87ed7fe208e already deleted. [ 1305.187061] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b6d86fb6-2897-4e0b-8601-d87ed7fe208e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.132104] env[70614]: INFO networking_nsxv3.common.synchronization [None req-eded220f-3865-4fee-9c3a-2a8982845533 None None] Enqueued Resource ID: dc36d609-9142-4d06-9fd4-136abf8701c9 with Priority: HIGHEST for action port [ 1306.132680] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc36d609-9142-4d06-9fd4-136abf8701c9 with Priority: HIGHEST for action port [ 1306.133402] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-dc36d609-9142-4d06-9fd4-136abf8701c9 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.133402] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dc36d609-9142-4d06-9fd4-136abf8701c9" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.133402] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dc36d609-9142-4d06-9fd4-136abf8701c9" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.133664] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dc36d609-9142-4d06-9fd4-136abf8701c9" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.133728] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc36d609-9142-4d06-9fd4-136abf8701c9',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.636008] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dc36d609-9142-4d06-9fd4-136abf8701c9 [ 1306.636252] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.636448] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.636565] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.636746] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.636836] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.636968] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dc36d609-9142-4d06-9fd4-136abf8701c9 already deleted. [ 1306.637025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dc36d609-9142-4d06-9fd4-136abf8701c9" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.091114] env[70614]: INFO networking_nsxv3.common.synchronization [req-6cdb453c-4f75-4f8e-8ce9-c3f95e682eab req-49e7d30b-6244-47d4-b695-57016848aeea tempest-AttachVolumeShelveTestJSON-232337985 tempest-AttachVolumeShelveTestJSON-232337985-project-member] Enqueued Resource ID: b6d86fb6-2897-4e0b-8601-d87ed7fe208e with Priority: HIGHEST for action security_group_members [ 1310.091767] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6d86fb6-2897-4e0b-8601-d87ed7fe208e with Priority: HIGHEST for action security_group_members [ 1310.092164] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6d86fb6-2897-4e0b-8601-d87ed7fe208e taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.092298] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6d86fb6-2897-4e0b-8601-d87ed7fe208e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.092352] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6d86fb6-2897-4e0b-8601-d87ed7fe208e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.092649] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6d86fb6-2897-4e0b-8601-d87ed7fe208e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.092804] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.092906] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.092968] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.093140] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.093226] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.093336] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b6d86fb6-2897-4e0b-8601-d87ed7fe208e',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.267291] env[70614]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1310.267430] env[70614]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] NSXv3 Agent Agent loop - iteration:3 started [ 1310.406668] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-657 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.406909] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-657" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.407076] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-657" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.407423] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-657" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.407718] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.407916] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.408191] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.409060] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.409060] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.409285] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1310.409417] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1310.409538] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1310.409654] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1310.409770] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1310.409879] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1310.410027] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1310.430960] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1310.431172] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1310.431295] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1310.431563] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-657" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.431890] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-a2233698-ae14-48c7-83ac-600772a63eda taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.432075] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-a2233698-ae14-48c7-83ac-600772a63eda" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.432203] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-a2233698-ae14-48c7-83ac-600772a63eda" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.432595] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-a2233698-ae14-48c7-83ac-600772a63eda" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.432864] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2233698-ae14-48c7-83ac-600772a63eda',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.595513] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.595732] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.595732] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.595944] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.596054] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.596249] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.596343] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.596397] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.596548] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.596615] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.596701] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6d86fb6-2897-4e0b-8601-d87ed7fe208e already deleted. [ 1310.596776] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6d86fb6-2897-4e0b-8601-d87ed7fe208e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.935282] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.935514] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.935649] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.935997] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.936180] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.936345] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port a2233698-ae14-48c7-83ac-600772a63eda not found, creating... [ 1310.936624] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.936790] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.936913] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.937154] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.937297] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.937583] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.937748] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.937869] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.938090] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.938227] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.938373] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: a2233698-ae14-48c7-83ac-600772a63eda is going to be created. [ 1310.960058] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.960309] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.960444] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.960728] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.960964] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.961214] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-a2233698-ae14-48c7-83ac-600772a63eda" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.654922] env[70614]: INFO networking_nsxv3.common.synchronization [req-6cdb453c-4f75-4f8e-8ce9-c3f95e682eab req-48b1cdc2-e1ad-4dad-9579-78a73f0ec871 service nova] Enqueued Resource ID: b6d86fb6-2897-4e0b-8601-d87ed7fe208e with Priority: HIGHEST for action security_group_rules [ 1311.655220] env[70614]: INFO networking_nsxv3.common.synchronization [req-6cdb453c-4f75-4f8e-8ce9-c3f95e682eab req-48b1cdc2-e1ad-4dad-9579-78a73f0ec871 service nova] Enqueued Resource ID: b6d86fb6-2897-4e0b-8601-d87ed7fe208e with Priority: HIGHEST for action security_group_members [ 1311.655272] env[70614]: INFO networking_nsxv3.common.synchronization [req-6cdb453c-4f75-4f8e-8ce9-c3f95e682eab req-48b1cdc2-e1ad-4dad-9579-78a73f0ec871 service nova] Enqueued Resource ID: a2233698-ae14-48c7-83ac-600772a63eda with Priority: HIGHEST for action port [ 1311.655488] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6d86fb6-2897-4e0b-8601-d87ed7fe208e with Priority: HIGHEST for action security_group_rules [ 1311.655678] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6d86fb6-2897-4e0b-8601-d87ed7fe208e with Priority: HIGHEST for action security_group_members [ 1311.655731] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2233698-ae14-48c7-83ac-600772a63eda with Priority: HIGHEST for action port [ 1311.656793] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b6d86fb6-2897-4e0b-8601-d87ed7fe208e taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.656930] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b6d86fb6-2897-4e0b-8601-d87ed7fe208e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.656998] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b6d86fb6-2897-4e0b-8601-d87ed7fe208e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.657227] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b6d86fb6-2897-4e0b-8601-d87ed7fe208e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.657311] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b6d86fb6-2897-4e0b-8601-d87ed7fe208e',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.659803] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6d86fb6-2897-4e0b-8601-d87ed7fe208e taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.659803] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6d86fb6-2897-4e0b-8601-d87ed7fe208e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.659803] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6d86fb6-2897-4e0b-8601-d87ed7fe208e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.659803] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6d86fb6-2897-4e0b-8601-d87ed7fe208e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.659803] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.659803] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.659803] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.659803] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.659803] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.659803] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b6d86fb6-2897-4e0b-8601-d87ed7fe208e',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.661280] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-a2233698-ae14-48c7-83ac-600772a63eda taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.661453] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a2233698-ae14-48c7-83ac-600772a63eda" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.661453] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a2233698-ae14-48c7-83ac-600772a63eda" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.661571] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a2233698-ae14-48c7-83ac-600772a63eda" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.661649] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2233698-ae14-48c7-83ac-600772a63eda',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1312.159107] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6d86fb6-2897-4e0b-8601-d87ed7fe208e taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.159357] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6d86fb6-2897-4e0b-8601-d87ed7fe208e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.163686] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b6d86fb6-2897-4e0b-8601-d87ed7fe208e',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1312.164639] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a2233698-ae14-48c7-83ac-600772a63eda with status ACTIVE [ 1312.164843] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.164968] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.165048] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.165256] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.165364] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.165546] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.165645] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.165736] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.165908] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.165988] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.166187] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.166277] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.166333] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.166475] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.166566] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.166653] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a2233698-ae14-48c7-83ac-600772a63eda is going to be updated. [ 1312.188573] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.188801] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.188801] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.189572] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.189572] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.189572] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a2233698-ae14-48c7-83ac-600772a63eda" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.668689] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b6d86fb6-2897-4e0b-8601-d87ed7fe208e',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.175201] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.175443] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.175443] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.175690] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.175777] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.175886] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6d86fb6-2897-4e0b-8601-d87ed7fe208e is going to be created. [ 1313.207082] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.207428] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.207428] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.207693] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.207935] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.219070] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6d86fb6-2897-4e0b-8601-d87ed7fe208e in Status: UNINITIALIZED for 2s [ 1315.231150] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6d86fb6-2897-4e0b-8601-d87ed7fe208e in Status: SUCCESS [ 1315.231470] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6d86fb6-2897-4e0b-8601-d87ed7fe208e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.231621] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6d86fb6-2897-4e0b-8601-d87ed7fe208e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.231961] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6d86fb6-2897-4e0b-8601-d87ed7fe208e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.232213] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.232402] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.232483] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.232718] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.232850] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.233027] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6d86fb6-2897-4e0b-8601-d87ed7fe208e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.233189] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b6d86fb6-2897-4e0b-8601-d87ed7fe208e',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1315.735923] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b6d86fb6-2897-4e0b-8601-d87ed7fe208e',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1315.906926] env[70614]: INFO networking_nsxv3.common.synchronization [req-efe03345-6531-4de0-9f0c-e1a19c78c196 req-a68b293e-76df-403d-b51a-b0f886c62653 tempest-ServerActionsTestOtherA-302418031 tempest-ServerActionsTestOtherA-302418031-project-member] Enqueued Resource ID: f58ad372-72ca-472a-aab5-8b86e9d2f1e6 with Priority: HIGHEST for action security_group_members [ 1315.907610] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f58ad372-72ca-472a-aab5-8b86e9d2f1e6 with Priority: HIGHEST for action security_group_members [ 1315.907979] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-f58ad372-72ca-472a-aab5-8b86e9d2f1e6 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.908114] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f58ad372-72ca-472a-aab5-8b86e9d2f1e6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.908195] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f58ad372-72ca-472a-aab5-8b86e9d2f1e6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.908489] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f58ad372-72ca-472a-aab5-8b86e9d2f1e6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.908593] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.908689] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.908765] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.908934] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.909046] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.909172] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f58ad372-72ca-472a-aab5-8b86e9d2f1e6',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.326568] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b6d86fb6-2897-4e0b-8601-d87ed7fe208e: rpc.has_security_group_logging(os_id): False [ 1316.326568] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.326568] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.326568] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.326568] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.326568] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.326568] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.326568] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.326568] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.326568] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.326568] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.326568] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b6d86fb6-2897-4e0b-8601-d87ed7fe208e is going to be created. [ 1316.346928] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.347039] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.347150] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.347317] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.347513] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.375541] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b6d86fb6-2897-4e0b-8601-d87ed7fe208e in Status: IN_PROGRESS for 2s [ 1316.411210] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.411532] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.411532] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.411819] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.411914] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.412137] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.412229] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.412328] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.412475] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.412559] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.412667] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f58ad372-72ca-472a-aab5-8b86e9d2f1e6 is going to be updated. [ 1316.464122] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.464338] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.464434] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.464696] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.464943] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.493060] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f58ad372-72ca-472a-aab5-8b86e9d2f1e6 in Status: IN_PROGRESS for 2s [ 1318.387547] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b6d86fb6-2897-4e0b-8601-d87ed7fe208e in Status: SUCCESS [ 1318.387547] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b6d86fb6-2897-4e0b-8601-d87ed7fe208e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.504496] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f58ad372-72ca-472a-aab5-8b86e9d2f1e6 in Status: SUCCESS [ 1318.504691] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f58ad372-72ca-472a-aab5-8b86e9d2f1e6 deletion is rescheduled due to dependency. [ 1318.504794] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f58ad372-72ca-472a-aab5-8b86e9d2f1e6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.908767] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1320.908767] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1324.538022] env[70614]: INFO networking_nsxv3.common.synchronization [None req-5777aae7-c7bc-44f9-976b-ca69b2bfa459 None None] Enqueued Resource ID: b877955d-4ee2-40c8-a9f7-b926866deb9d with Priority: HIGHEST for action port [ 1324.538571] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b877955d-4ee2-40c8-a9f7-b926866deb9d with Priority: HIGHEST for action port [ 1324.538880] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-b877955d-4ee2-40c8-a9f7-b926866deb9d taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.539148] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b877955d-4ee2-40c8-a9f7-b926866deb9d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.539258] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b877955d-4ee2-40c8-a9f7-b926866deb9d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.539555] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b877955d-4ee2-40c8-a9f7-b926866deb9d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.539628] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b877955d-4ee2-40c8-a9f7-b926866deb9d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1324.841143] env[70614]: INFO networking_nsxv3.common.synchronization [None req-59bf4891-7c56-4b77-942c-dac50854d096 tempest-AttachVolumeNegativeTest-1085254203 tempest-AttachVolumeNegativeTest-1085254203-project-member] Enqueued Resource ID: a034d096-40a8-4ee7-8cb1-e9d03d795d6a with Priority: HIGHEST for action security_group_rules [ 1324.842328] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a034d096-40a8-4ee7-8cb1-e9d03d795d6a with Priority: HIGHEST for action security_group_rules [ 1324.842642] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a034d096-40a8-4ee7-8cb1-e9d03d795d6a taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.842770] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a034d096-40a8-4ee7-8cb1-e9d03d795d6a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.842904] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a034d096-40a8-4ee7-8cb1-e9d03d795d6a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.843179] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a034d096-40a8-4ee7-8cb1-e9d03d795d6a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.843267] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a034d096-40a8-4ee7-8cb1-e9d03d795d6a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1324.933570] env[70614]: INFO networking_nsxv3.common.synchronization [None req-c242b1b0-36fd-42bd-b75e-e9b7b2d473c3 tempest-AttachVolumeNegativeTest-1085254203 tempest-AttachVolumeNegativeTest-1085254203-project-member] Enqueued Resource ID: a034d096-40a8-4ee7-8cb1-e9d03d795d6a with Priority: HIGHEST for action security_group_rules [ 1324.934202] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a034d096-40a8-4ee7-8cb1-e9d03d795d6a with Priority: HIGHEST for action security_group_rules [ 1324.934528] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a034d096-40a8-4ee7-8cb1-e9d03d795d6a taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.934698] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a034d096-40a8-4ee7-8cb1-e9d03d795d6a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.041911] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b877955d-4ee2-40c8-a9f7-b926866deb9d [ 1325.042166] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.042301] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.042433] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.042621] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.042710] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.042813] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b877955d-4ee2-40c8-a9f7-b926866deb9d already deleted. [ 1325.042918] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b877955d-4ee2-40c8-a9f7-b926866deb9d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.367445] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.367445] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.367445] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.367445] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.367445] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.367445] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a034d096-40a8-4ee7-8cb1-e9d03d795d6a already deleted. [ 1325.367445] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a034d096-40a8-4ee7-8cb1-e9d03d795d6a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.367445] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a034d096-40a8-4ee7-8cb1-e9d03d795d6a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.367445] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a034d096-40a8-4ee7-8cb1-e9d03d795d6a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.367445] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a034d096-40a8-4ee7-8cb1-e9d03d795d6a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.886690] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.886959] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.886959] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.887185] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.887185] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.887392] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a034d096-40a8-4ee7-8cb1-e9d03d795d6a already deleted. [ 1325.887392] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a034d096-40a8-4ee7-8cb1-e9d03d795d6a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.938055] env[70614]: INFO networking_nsxv3.common.synchronization [req-94d7c635-92dc-4d3a-87f9-122c74e587e5 req-1205757d-aecd-4a9a-92a0-33c94bd19e80 tempest-ServerActionsTestJSON-366333930 tempest-ServerActionsTestJSON-366333930-project-member] Enqueued Resource ID: def9aa42-470d-498e-9034-6879fb1e6ebc with Priority: HIGHEST for action security_group_members [ 1325.938627] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: def9aa42-470d-498e-9034-6879fb1e6ebc with Priority: HIGHEST for action security_group_members [ 1325.939025] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-def9aa42-470d-498e-9034-6879fb1e6ebc taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.939182] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.939182] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.939390] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.944930] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.944930] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.944930] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.945146] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.945146] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.945248] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('def9aa42-470d-498e-9034-6879fb1e6ebc',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1326.447769] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.447926] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.448026] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.448221] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.448314] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.448503] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.448600] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.448661] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.448806] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.448878] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.448965] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: def9aa42-470d-498e-9034-6879fb1e6ebc is going to be updated. [ 1326.479406] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.479617] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.479617] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.479898] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.479988] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.488277] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: def9aa42-470d-498e-9034-6879fb1e6ebc in Status: IN_PROGRESS for 2s [ 1326.996927] env[70614]: INFO networking_nsxv3.common.synchronization [None req-ee0d2046-61a2-4297-9602-fb1416e9acc8 None None] Enqueued Resource ID: 3d930d70-eac2-49c1-9826-72dfb56d1061 with Priority: HIGHEST for action port [ 1326.997225] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d930d70-eac2-49c1-9826-72dfb56d1061 with Priority: HIGHEST for action port [ 1326.997426] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-3d930d70-eac2-49c1-9826-72dfb56d1061 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.997570] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3d930d70-eac2-49c1-9826-72dfb56d1061" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.997651] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3d930d70-eac2-49c1-9826-72dfb56d1061" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.999095] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3d930d70-eac2-49c1-9826-72dfb56d1061" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.999095] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d930d70-eac2-49c1-9826-72dfb56d1061',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.500333] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3d930d70-eac2-49c1-9826-72dfb56d1061 [ 1327.500553] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.500699] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.500763] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.500992] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.501101] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.501187] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3d930d70-eac2-49c1-9826-72dfb56d1061 already deleted. [ 1327.501267] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3d930d70-eac2-49c1-9826-72dfb56d1061" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.499214] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: def9aa42-470d-498e-9034-6879fb1e6ebc in Status: SUCCESS [ 1328.499533] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: def9aa42-470d-498e-9034-6879fb1e6ebc deletion is rescheduled due to dependency. [ 1328.499578] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.519782] env[70614]: INFO networking_nsxv3.common.synchronization [req-ac3129ee-2519-4e3d-a8f9-98cc13511e6f req-6c008b58-4642-42bb-8950-89d2e2f01302 tempest-AttachVolumeNegativeTest-1085254203 tempest-AttachVolumeNegativeTest-1085254203-project-member] Enqueued Resource ID: a034d096-40a8-4ee7-8cb1-e9d03d795d6a with Priority: HIGHEST for action security_group_members [ 1330.520305] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a034d096-40a8-4ee7-8cb1-e9d03d795d6a with Priority: HIGHEST for action security_group_members [ 1330.520305] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-a034d096-40a8-4ee7-8cb1-e9d03d795d6a taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.520305] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a034d096-40a8-4ee7-8cb1-e9d03d795d6a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.520305] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a034d096-40a8-4ee7-8cb1-e9d03d795d6a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.520305] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a034d096-40a8-4ee7-8cb1-e9d03d795d6a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.520305] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.520305] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.520305] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.520305] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.520305] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.520305] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a034d096-40a8-4ee7-8cb1-e9d03d795d6a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.787239] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-574 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.787451] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-574" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.787583] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-574" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.787925] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-574" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.788207] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.788369] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.788488] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.788715] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.788883] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.789267] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1330.789418] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1330.789544] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1330.789663] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1330.789772] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1330.789936] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1330.790173] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1330.811573] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1330.811802] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1330.811951] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1330.812148] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-574" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.812469] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-82008e0c-8e1d-4e87-a8b5-e437c10a32b2 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.812634] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-82008e0c-8e1d-4e87-a8b5-e437c10a32b2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.812757] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-82008e0c-8e1d-4e87-a8b5-e437c10a32b2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.813087] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-82008e0c-8e1d-4e87-a8b5-e437c10a32b2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.813297] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82008e0c-8e1d-4e87-a8b5-e437c10a32b2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.024525] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.024728] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.024728] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.024904] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.024989] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.025199] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.025294] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.025347] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.025493] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.025562] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.025641] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a034d096-40a8-4ee7-8cb1-e9d03d795d6a already deleted. [ 1331.025717] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a034d096-40a8-4ee7-8cb1-e9d03d795d6a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.316130] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.316414] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.316509] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.316756] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.316907] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.317080] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 82008e0c-8e1d-4e87-a8b5-e437c10a32b2 not found, creating... [ 1331.317344] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.317502] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.317620] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.317837] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.317970] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.318259] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.318418] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.318531] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.318738] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.318910] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.319076] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 82008e0c-8e1d-4e87-a8b5-e437c10a32b2 is going to be created. [ 1331.338803] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.339034] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.339137] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.339401] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.339683] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.339914] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-82008e0c-8e1d-4e87-a8b5-e437c10a32b2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.025435] env[70614]: INFO networking_nsxv3.common.synchronization [req-ac3129ee-2519-4e3d-a8f9-98cc13511e6f req-c242403f-696b-4137-b532-4ab2107485d3 service nova] Enqueued Resource ID: a034d096-40a8-4ee7-8cb1-e9d03d795d6a with Priority: HIGHEST for action security_group_rules [ 1332.025699] env[70614]: INFO networking_nsxv3.common.synchronization [req-ac3129ee-2519-4e3d-a8f9-98cc13511e6f req-c242403f-696b-4137-b532-4ab2107485d3 service nova] Enqueued Resource ID: a034d096-40a8-4ee7-8cb1-e9d03d795d6a with Priority: HIGHEST for action security_group_members [ 1332.025749] env[70614]: INFO networking_nsxv3.common.synchronization [req-ac3129ee-2519-4e3d-a8f9-98cc13511e6f req-c242403f-696b-4137-b532-4ab2107485d3 service nova] Enqueued Resource ID: 82008e0c-8e1d-4e87-a8b5-e437c10a32b2 with Priority: HIGHEST for action port [ 1332.025969] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a034d096-40a8-4ee7-8cb1-e9d03d795d6a with Priority: HIGHEST for action security_group_rules [ 1332.026115] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a034d096-40a8-4ee7-8cb1-e9d03d795d6a with Priority: HIGHEST for action security_group_members [ 1332.026214] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82008e0c-8e1d-4e87-a8b5-e437c10a32b2 with Priority: HIGHEST for action port [ 1332.026733] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a034d096-40a8-4ee7-8cb1-e9d03d795d6a taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.026855] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a034d096-40a8-4ee7-8cb1-e9d03d795d6a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.026923] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a034d096-40a8-4ee7-8cb1-e9d03d795d6a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.027135] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a034d096-40a8-4ee7-8cb1-e9d03d795d6a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.027218] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a034d096-40a8-4ee7-8cb1-e9d03d795d6a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.028059] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-a034d096-40a8-4ee7-8cb1-e9d03d795d6a taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.028172] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a034d096-40a8-4ee7-8cb1-e9d03d795d6a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.028239] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a034d096-40a8-4ee7-8cb1-e9d03d795d6a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.028397] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a034d096-40a8-4ee7-8cb1-e9d03d795d6a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.028538] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.028632] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.028693] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.028830] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.028913] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.028999] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a034d096-40a8-4ee7-8cb1-e9d03d795d6a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.029714] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-82008e0c-8e1d-4e87-a8b5-e437c10a32b2 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.030080] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-82008e0c-8e1d-4e87-a8b5-e437c10a32b2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.030080] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-82008e0c-8e1d-4e87-a8b5-e437c10a32b2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.030152] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-82008e0c-8e1d-4e87-a8b5-e437c10a32b2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.030196] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82008e0c-8e1d-4e87-a8b5-e437c10a32b2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.532220] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-a034d096-40a8-4ee7-8cb1-e9d03d795d6a taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.532357] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a034d096-40a8-4ee7-8cb1-e9d03d795d6a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.532556] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a034d096-40a8-4ee7-8cb1-e9d03d795d6a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.533525] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 82008e0c-8e1d-4e87-a8b5-e437c10a32b2 with status ACTIVE [ 1332.533712] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.533827] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.533891] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.534128] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.534218] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.534388] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.534511] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.534576] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.534726] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.534856] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.535321] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.535446] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.535517] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.535683] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.535775] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.535849] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 82008e0c-8e1d-4e87-a8b5-e437c10a32b2 is going to be updated. [ 1332.558273] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.558463] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.558520] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.558781] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.558954] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.559159] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-82008e0c-8e1d-4e87-a8b5-e437c10a32b2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.039133] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a034d096-40a8-4ee7-8cb1-e9d03d795d6a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1333.541325] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.541581] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.541641] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.541814] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.541902] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.542010] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a034d096-40a8-4ee7-8cb1-e9d03d795d6a is going to be created. [ 1333.565175] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.565365] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.565415] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.565593] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.565754] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.577377] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a034d096-40a8-4ee7-8cb1-e9d03d795d6a in Status: UNINITIALIZED for 2s [ 1335.588306] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a034d096-40a8-4ee7-8cb1-e9d03d795d6a in Status: SUCCESS [ 1335.588306] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a034d096-40a8-4ee7-8cb1-e9d03d795d6a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.588766] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a034d096-40a8-4ee7-8cb1-e9d03d795d6a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.588766] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a034d096-40a8-4ee7-8cb1-e9d03d795d6a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.588860] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.588925] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.588970] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.589116] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.589202] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.589291] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a034d096-40a8-4ee7-8cb1-e9d03d795d6a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.589384] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a034d096-40a8-4ee7-8cb1-e9d03d795d6a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1336.092260] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a034d096-40a8-4ee7-8cb1-e9d03d795d6a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1336.594086] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a034d096-40a8-4ee7-8cb1-e9d03d795d6a: rpc.has_security_group_logging(os_id): False [ 1336.610676] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.610833] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.610908] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.611125] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.611218] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.611580] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.611644] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.611678] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.611817] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.611891] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.611980] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a034d096-40a8-4ee7-8cb1-e9d03d795d6a is going to be created. [ 1336.667214] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.667419] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.667419] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.667622] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.667803] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.679381] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a034d096-40a8-4ee7-8cb1-e9d03d795d6a in Status: IN_PROGRESS for 2s [ 1336.837957] env[70614]: INFO networking_nsxv3.common.synchronization [req-2e4be00a-269d-4d6e-b1ba-c2fb6c5405c7 req-d99a26ea-be85-4b7c-8f9d-e6ae42f05207 tempest-ServerActionsTestJSON-366333930 tempest-ServerActionsTestJSON-366333930-project-member] Enqueued Resource ID: def9aa42-470d-498e-9034-6879fb1e6ebc with Priority: HIGHEST for action security_group_members [ 1336.839652] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: def9aa42-470d-498e-9034-6879fb1e6ebc with Priority: HIGHEST for action security_group_members [ 1336.839652] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-def9aa42-470d-498e-9034-6879fb1e6ebc taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.839652] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.839652] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.839652] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.840346] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.840346] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.840346] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.840346] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.840346] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.840346] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('def9aa42-470d-498e-9034-6879fb1e6ebc',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1337.091966] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-117 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.091966] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-117" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.092288] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-117" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.092349] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-117" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.092617] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.092777] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.092899] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.093286] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.093511] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.093756] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1337.093876] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1337.093987] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1337.094111] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1337.094520] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1337.094520] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1337.094520] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1337.112838] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1337.113025] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1337.113172] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1337.113347] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-117" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.113656] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-7cdcf54f-9d3c-49a9-9ac1-0ccc1af70358 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.113894] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-7cdcf54f-9d3c-49a9-9ac1-0ccc1af70358" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.114046] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-7cdcf54f-9d3c-49a9-9ac1-0ccc1af70358" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.114382] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-7cdcf54f-9d3c-49a9-9ac1-0ccc1af70358" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.114529] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7cdcf54f-9d3c-49a9-9ac1-0ccc1af70358',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1337.341914] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.342170] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.342170] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.342391] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.342483] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.342683] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.342786] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.342845] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.343039] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.343126] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.343208] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: def9aa42-470d-498e-9034-6879fb1e6ebc is going to be updated. [ 1337.374551] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.374868] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.374868] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.375108] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.375263] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.384086] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: def9aa42-470d-498e-9034-6879fb1e6ebc in Status: IN_PROGRESS for 2s [ 1337.617201] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.617620] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.617620] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.617795] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.617945] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.618127] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 7cdcf54f-9d3c-49a9-9ac1-0ccc1af70358 not found, creating... [ 1337.618497] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.618635] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.618675] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.618890] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.619038] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.619438] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.619640] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.619762] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.619978] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.620128] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.620272] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 7cdcf54f-9d3c-49a9-9ac1-0ccc1af70358 is going to be created. [ 1337.641406] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.641690] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.641737] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.641997] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.642358] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.642689] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-7cdcf54f-9d3c-49a9-9ac1-0ccc1af70358" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.321690] env[70614]: INFO networking_nsxv3.common.synchronization [req-2e4be00a-269d-4d6e-b1ba-c2fb6c5405c7 req-76266b88-0c73-49e7-82fc-825b15a3943d service nova] Enqueued Resource ID: def9aa42-470d-498e-9034-6879fb1e6ebc with Priority: HIGHEST for action security_group_rules [ 1338.321992] env[70614]: INFO networking_nsxv3.common.synchronization [req-2e4be00a-269d-4d6e-b1ba-c2fb6c5405c7 req-76266b88-0c73-49e7-82fc-825b15a3943d service nova] Enqueued Resource ID: def9aa42-470d-498e-9034-6879fb1e6ebc with Priority: HIGHEST for action security_group_members [ 1338.322234] env[70614]: INFO networking_nsxv3.common.synchronization [req-2e4be00a-269d-4d6e-b1ba-c2fb6c5405c7 req-76266b88-0c73-49e7-82fc-825b15a3943d service nova] Enqueued Resource ID: 7cdcf54f-9d3c-49a9-9ac1-0ccc1af70358 with Priority: HIGHEST for action port [ 1338.322863] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: def9aa42-470d-498e-9034-6879fb1e6ebc with Priority: HIGHEST for action security_group_rules [ 1338.323088] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: def9aa42-470d-498e-9034-6879fb1e6ebc with Priority: HIGHEST for action security_group_members [ 1338.323432] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cdcf54f-9d3c-49a9-9ac1-0ccc1af70358 with Priority: HIGHEST for action port [ 1338.323733] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-def9aa42-470d-498e-9034-6879fb1e6ebc taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.323885] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.323978] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.324171] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.324253] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('def9aa42-470d-498e-9034-6879fb1e6ebc',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1338.325321] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-def9aa42-470d-498e-9034-6879fb1e6ebc taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.325450] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.325662] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-7cdcf54f-9d3c-49a9-9ac1-0ccc1af70358 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.325767] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7cdcf54f-9d3c-49a9-9ac1-0ccc1af70358" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.325830] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7cdcf54f-9d3c-49a9-9ac1-0ccc1af70358" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.325994] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7cdcf54f-9d3c-49a9-9ac1-0ccc1af70358" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.326084] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7cdcf54f-9d3c-49a9-9ac1-0ccc1af70358',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1338.691307] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a034d096-40a8-4ee7-8cb1-e9d03d795d6a in Status: SUCCESS [ 1338.691703] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a034d096-40a8-4ee7-8cb1-e9d03d795d6a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.827464] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-def9aa42-470d-498e-9034-6879fb1e6ebc taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.827653] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.830101] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7cdcf54f-9d3c-49a9-9ac1-0ccc1af70358 with status ACTIVE [ 1338.830358] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.830530] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.830633] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.830894] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.831015] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.831200] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.831302] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.831361] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.831583] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.831680] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.831887] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.832042] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.832110] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.832290] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.832385] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.832475] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7cdcf54f-9d3c-49a9-9ac1-0ccc1af70358 is going to be updated. [ 1338.867251] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.867468] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.867511] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.867739] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.867968] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.868178] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7cdcf54f-9d3c-49a9-9ac1-0ccc1af70358" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.393891] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: def9aa42-470d-498e-9034-6879fb1e6ebc in Status: SUCCESS [ 1339.394097] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: def9aa42-470d-498e-9034-6879fb1e6ebc deletion is rescheduled due to dependency. [ 1339.394210] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.394368] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.394581] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.394766] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.394880] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.394942] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.395101] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.395177] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.395272] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('def9aa42-470d-498e-9034-6879fb1e6ebc',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1339.897857] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('def9aa42-470d-498e-9034-6879fb1e6ebc',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1340.400461] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('def9aa42-470d-498e-9034-6879fb1e6ebc',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1340.902867] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.902867] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.902867] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.903794] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.903794] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.903794] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: def9aa42-470d-498e-9034-6879fb1e6ebc is going to be updated. [ 1340.934899] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.934899] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.934899] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.934899] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.934899] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.947354] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: def9aa42-470d-498e-9034-6879fb1e6ebc in Status: IN_PROGRESS for 2s [ 1342.958281] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: def9aa42-470d-498e-9034-6879fb1e6ebc in Status: SUCCESS [ 1342.958698] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.958737] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.958957] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.959167] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.959286] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.959353] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.959523] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.959601] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.959683] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.959792] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('def9aa42-470d-498e-9034-6879fb1e6ebc',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.324823] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1343.325145] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1343.461867] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('def9aa42-470d-498e-9034-6879fb1e6ebc',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.963978] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for def9aa42-470d-498e-9034-6879fb1e6ebc: rpc.has_security_group_logging(os_id): False [ 1343.981369] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.981592] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.981592] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.981839] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.981967] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.982166] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.982265] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.982330] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.982473] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.982564] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.982656] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: def9aa42-470d-498e-9034-6879fb1e6ebc is going to be updated. [ 1344.039725] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.039968] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.039968] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.040151] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.040300] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.058944] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: def9aa42-470d-498e-9034-6879fb1e6ebc in Status: IN_PROGRESS for 2s [ 1346.072860] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: def9aa42-470d-498e-9034-6879fb1e6ebc in Status: SUCCESS [ 1346.073299] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.325844] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1348.326245] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1352.227918] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.228361] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.228361] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.228524] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.228691] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1352.731014] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1353.233690] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1353.327377] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1353.327641] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1353.736656] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1353.736874] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1354.459364] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.459814] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.459814] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.459814] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.472753] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1354.473591] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.474387] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1354.511262] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.511545] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.511545] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.511721] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.526559] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.527216] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1354.527303] env[70614]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=70614) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1354.527392] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1354.564105] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.564260] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.564316] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.564512] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.565719] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.565938] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1354.644229] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.644468] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.644468] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.644650] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.644954] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.645229] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1354.728079] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.728309] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.728309] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.728469] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.728813] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.729096] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:40. [ 1354.729184] env[70614]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'4e54f39e-349d-49ad-bb07-348488d846f0', 'a034d096-40a8-4ee7-8cb1-e9d03d795d6a', '57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e', 'def9aa42-470d-498e-9034-6879fb1e6ebc', 'ca55d9c7-11be-476b-bdb5-63e4c956a4de', '3177f360-f74b-456a-9c1b-681726056f53', '28809bb1-c80b-4696-9980-5f00f47130bb', '31d51b9f-24c2-407d-92f6-bfa0a20cfef8', '81470f34-f44d-4111-b9a8-fc43c119e1dd', 'e23923e3-0ade-47cf-aa89-03f9a991b3f7', 'b55beff3-0092-4844-958f-ed6f6ef8b108', 'd141340f-d099-4b67-88b0-348423856ab2', '9e717c4b-1f67-4d20-9afd-677fdceb923a', 'ca853b04-ee44-46f5-a78c-096d9284c247', 'f58ad372-72ca-472a-aab5-8b86e9d2f1e6', '03fa4ca9-532b-43b0-bd53-de11eea0a016', '2db7d87e-43a6-451c-9080-385c174466ee', '9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1', 'b6d86fb6-2897-4e0b-8601-d87ed7fe208e', '8004bc6e-552e-4ff4-87f0-242b54bbfb5d', '336e562f-9c8e-4021-953e-5756518b10b0', '3496e6be-51c4-4b7a-9789-b13bae7f2cda', 'ad8b8cdd-7eee-48c2-8c33-7b83fde75038', '1440acfc-c5d6-4a44-b0a8-654c4f16a7d1', '45904912-7759-4b89-83ba-2a95c86ca5fd', 'ecaff113-395f-46a3-b8a5-a3ce5cb003a5', '76d591d6-9294-4288-b5c9-f6b7e2b45562', '406660af-f92d-476c-ab5f-e3168c58847d', '77b7addf-0db2-4091-a32b-1272c6ac49b5', 'b20ed1f0-7f46-40ac-882f-36a610d96a98', '77761344-a891-4e31-9381-80451d04a355', 'dd5a38a7-babd-4c6b-b3a5-af13dd79865d', 'ec4cc5da-964e-43e8-9531-6581ec387b4d', '3f4770f9-9c1b-48b7-8d14-3089a02098e4', 'e8c65e5a-d52c-481c-a6b2-680dae9a4593', 'ced2222f-152a-4951-8da3-65259a9e32af', 'f0060547-03fb-4d1a-ad8e-69519760b908', '3172accd-a4e8-4297-999e-158d19f8d74b', '63a56402-3dcf-44d4-b33d-a56ff531a12c', '94eb8a38-d1bf-4747-a73b-c4d0ea236bc3'} {{(pid=70614) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1354.729345] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1354.748521] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.748775] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.748775] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.748945] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.749044] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.749159] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1354.749230] env[70614]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=70614) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1354.749302] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1354.815754] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.816072] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.816072] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.816278] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.817429] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.817743] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1354.817824] env[70614]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=70614) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1354.817892] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1354.817961] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1354.818051] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/40 resources of Type:Security Group Rules [ 1354.818121] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4e54f39e-349d-49ad-bb07-348488d846f0 with Priority: HIGH for action security_group_rules [ 1354.818201] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a034d096-40a8-4ee7-8cb1-e9d03d795d6a with Priority: HIGH for action security_group_rules [ 1354.818268] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e with Priority: HIGH for action security_group_rules [ 1354.818331] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: def9aa42-470d-498e-9034-6879fb1e6ebc with Priority: HIGH for action security_group_rules [ 1354.818388] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ca55d9c7-11be-476b-bdb5-63e4c956a4de with Priority: HIGH for action security_group_rules [ 1354.818445] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3177f360-f74b-456a-9c1b-681726056f53 with Priority: HIGH for action security_group_rules [ 1354.818539] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 28809bb1-c80b-4696-9980-5f00f47130bb with Priority: HIGH for action security_group_rules [ 1354.818637] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 31d51b9f-24c2-407d-92f6-bfa0a20cfef8 with Priority: HIGH for action security_group_rules [ 1354.818737] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 81470f34-f44d-4111-b9a8-fc43c119e1dd with Priority: HIGH for action security_group_rules [ 1354.818813] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e23923e3-0ade-47cf-aa89-03f9a991b3f7 with Priority: HIGH for action security_group_rules [ 1354.818890] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b55beff3-0092-4844-958f-ed6f6ef8b108 with Priority: HIGH for action security_group_rules [ 1354.818964] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d141340f-d099-4b67-88b0-348423856ab2 with Priority: HIGH for action security_group_rules [ 1354.819068] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9e717c4b-1f67-4d20-9afd-677fdceb923a with Priority: HIGH for action security_group_rules [ 1354.819168] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ca853b04-ee44-46f5-a78c-096d9284c247 with Priority: HIGH for action security_group_rules [ 1354.819271] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f58ad372-72ca-472a-aab5-8b86e9d2f1e6 with Priority: HIGH for action security_group_rules [ 1354.819376] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 03fa4ca9-532b-43b0-bd53-de11eea0a016 with Priority: HIGH for action security_group_rules [ 1354.819467] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2db7d87e-43a6-451c-9080-385c174466ee with Priority: HIGH for action security_group_rules [ 1354.819535] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1 with Priority: HIGH for action security_group_rules [ 1354.819608] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b6d86fb6-2897-4e0b-8601-d87ed7fe208e with Priority: HIGH for action security_group_rules [ 1354.819668] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8004bc6e-552e-4ff4-87f0-242b54bbfb5d with Priority: HIGH for action security_group_rules [ 1354.819804] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.329177] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1358.329549] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1358.329549] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e54f39e-349d-49ad-bb07-348488d846f0 with Priority: HIGH for action security_group_rules [ 1358.329549] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e with Priority: HIGH for action security_group_rules [ 1358.329729] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28809bb1-c80b-4696-9980-5f00f47130bb with Priority: HIGH for action security_group_rules [ 1358.329729] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f58ad372-72ca-472a-aab5-8b86e9d2f1e6 with Priority: HIGH for action security_group_rules [ 1358.329824] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8004bc6e-552e-4ff4-87f0-242b54bbfb5d with Priority: HIGH for action security_group_rules [ 1358.329892] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6d86fb6-2897-4e0b-8601-d87ed7fe208e with Priority: HIGH for action security_group_rules [ 1358.329974] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1 with Priority: HIGH for action security_group_rules [ 1358.330076] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2db7d87e-43a6-451c-9080-385c174466ee with Priority: HIGH for action security_group_rules [ 1358.330213] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca853b04-ee44-46f5-a78c-096d9284c247 with Priority: HIGH for action security_group_rules [ 1358.330304] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03fa4ca9-532b-43b0-bd53-de11eea0a016 with Priority: HIGH for action security_group_rules [ 1358.330359] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e717c4b-1f67-4d20-9afd-677fdceb923a with Priority: HIGH for action security_group_rules [ 1358.330412] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d141340f-d099-4b67-88b0-348423856ab2 with Priority: HIGH for action security_group_rules [ 1358.330488] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b55beff3-0092-4844-958f-ed6f6ef8b108 with Priority: HIGH for action security_group_rules [ 1358.330572] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e23923e3-0ade-47cf-aa89-03f9a991b3f7 with Priority: HIGH for action security_group_rules [ 1358.330659] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81470f34-f44d-4111-b9a8-fc43c119e1dd with Priority: HIGH for action security_group_rules [ 1358.330746] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3177f360-f74b-456a-9c1b-681726056f53 with Priority: HIGH for action security_group_rules [ 1358.330831] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31d51b9f-24c2-407d-92f6-bfa0a20cfef8 with Priority: HIGH for action security_group_rules [ 1358.330917] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca55d9c7-11be-476b-bdb5-63e4c956a4de with Priority: HIGH for action security_group_rules [ 1358.331080] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a034d096-40a8-4ee7-8cb1-e9d03d795d6a with Priority: HIGH for action security_group_rules [ 1358.331240] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: def9aa42-470d-498e-9034-6879fb1e6ebc with Priority: HIGH for action security_group_rules [ 1358.331672] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e54f39e-349d-49ad-bb07-348488d846f0 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.331813] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.331953] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.332108] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.332189] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e54f39e-349d-49ad-bb07-348488d846f0',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1358.333227] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.333352] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.333424] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.333580] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.333656] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1358.334771] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-28809bb1-c80b-4696-9980-5f00f47130bb taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.334932] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-28809bb1-c80b-4696-9980-5f00f47130bb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.334932] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-28809bb1-c80b-4696-9980-5f00f47130bb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.335042] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-28809bb1-c80b-4696-9980-5f00f47130bb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.335125] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('28809bb1-c80b-4696-9980-5f00f47130bb',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1358.335814] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f58ad372-72ca-472a-aab5-8b86e9d2f1e6 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.335974] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f58ad372-72ca-472a-aab5-8b86e9d2f1e6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.335974] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f58ad372-72ca-472a-aab5-8b86e9d2f1e6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.336140] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f58ad372-72ca-472a-aab5-8b86e9d2f1e6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.336212] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f58ad372-72ca-472a-aab5-8b86e9d2f1e6',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1358.337030] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8004bc6e-552e-4ff4-87f0-242b54bbfb5d taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.337030] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8004bc6e-552e-4ff4-87f0-242b54bbfb5d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.337183] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8004bc6e-552e-4ff4-87f0-242b54bbfb5d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.337183] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8004bc6e-552e-4ff4-87f0-242b54bbfb5d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.337267] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8004bc6e-552e-4ff4-87f0-242b54bbfb5d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1358.337930] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b6d86fb6-2897-4e0b-8601-d87ed7fe208e taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.338017] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b6d86fb6-2897-4e0b-8601-d87ed7fe208e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.338074] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b6d86fb6-2897-4e0b-8601-d87ed7fe208e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.338222] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b6d86fb6-2897-4e0b-8601-d87ed7fe208e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.338292] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b6d86fb6-2897-4e0b-8601-d87ed7fe208e',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1358.339092] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.339225] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.339296] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.339623] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.339623] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1358.340192] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2db7d87e-43a6-451c-9080-385c174466ee taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.340288] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2db7d87e-43a6-451c-9080-385c174466ee" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.340350] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2db7d87e-43a6-451c-9080-385c174466ee" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.340530] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2db7d87e-43a6-451c-9080-385c174466ee" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.340589] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2db7d87e-43a6-451c-9080-385c174466ee',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1358.341219] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca853b04-ee44-46f5-a78c-096d9284c247 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.341319] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca853b04-ee44-46f5-a78c-096d9284c247" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.341401] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca853b04-ee44-46f5-a78c-096d9284c247" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.341533] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca853b04-ee44-46f5-a78c-096d9284c247" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.341605] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca853b04-ee44-46f5-a78c-096d9284c247',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1358.342281] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-03fa4ca9-532b-43b0-bd53-de11eea0a016 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.342456] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-03fa4ca9-532b-43b0-bd53-de11eea0a016" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.342506] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-03fa4ca9-532b-43b0-bd53-de11eea0a016" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.342651] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-03fa4ca9-532b-43b0-bd53-de11eea0a016" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.342747] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('03fa4ca9-532b-43b0-bd53-de11eea0a016',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1358.343448] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e717c4b-1f67-4d20-9afd-677fdceb923a taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.343554] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.343626] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.343762] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.343830] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e717c4b-1f67-4d20-9afd-677fdceb923a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1358.344481] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d141340f-d099-4b67-88b0-348423856ab2 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.344599] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.344641] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.344850] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.344850] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d141340f-d099-4b67-88b0-348423856ab2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1358.345482] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b55beff3-0092-4844-958f-ed6f6ef8b108 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.345589] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b55beff3-0092-4844-958f-ed6f6ef8b108" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.345671] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b55beff3-0092-4844-958f-ed6f6ef8b108" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.345801] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b55beff3-0092-4844-958f-ed6f6ef8b108" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.345871] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b55beff3-0092-4844-958f-ed6f6ef8b108',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1358.346509] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e23923e3-0ade-47cf-aa89-03f9a991b3f7 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.346610] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e23923e3-0ade-47cf-aa89-03f9a991b3f7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.346671] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e23923e3-0ade-47cf-aa89-03f9a991b3f7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.346830] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e23923e3-0ade-47cf-aa89-03f9a991b3f7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.346909] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e23923e3-0ade-47cf-aa89-03f9a991b3f7',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1358.347650] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-81470f34-f44d-4111-b9a8-fc43c119e1dd taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.347761] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-81470f34-f44d-4111-b9a8-fc43c119e1dd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.347821] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-81470f34-f44d-4111-b9a8-fc43c119e1dd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.347969] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-81470f34-f44d-4111-b9a8-fc43c119e1dd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.348049] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('81470f34-f44d-4111-b9a8-fc43c119e1dd',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1358.348697] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3177f360-f74b-456a-9c1b-681726056f53 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.348806] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3177f360-f74b-456a-9c1b-681726056f53" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.348865] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3177f360-f74b-456a-9c1b-681726056f53" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.349053] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3177f360-f74b-456a-9c1b-681726056f53" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.349107] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3177f360-f74b-456a-9c1b-681726056f53',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1358.349761] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-31d51b9f-24c2-407d-92f6-bfa0a20cfef8 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.349875] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-31d51b9f-24c2-407d-92f6-bfa0a20cfef8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.349936] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-31d51b9f-24c2-407d-92f6-bfa0a20cfef8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.350089] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-31d51b9f-24c2-407d-92f6-bfa0a20cfef8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.350158] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('31d51b9f-24c2-407d-92f6-bfa0a20cfef8',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1358.350895] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca55d9c7-11be-476b-bdb5-63e4c956a4de taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.351021] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca55d9c7-11be-476b-bdb5-63e4c956a4de" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.351063] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca55d9c7-11be-476b-bdb5-63e4c956a4de" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.351221] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca55d9c7-11be-476b-bdb5-63e4c956a4de" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.351300] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca55d9c7-11be-476b-bdb5-63e4c956a4de',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1358.351944] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a034d096-40a8-4ee7-8cb1-e9d03d795d6a taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.352054] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a034d096-40a8-4ee7-8cb1-e9d03d795d6a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.352132] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a034d096-40a8-4ee7-8cb1-e9d03d795d6a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.352263] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a034d096-40a8-4ee7-8cb1-e9d03d795d6a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.352329] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a034d096-40a8-4ee7-8cb1-e9d03d795d6a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1358.353025] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-def9aa42-470d-498e-9034-6879fb1e6ebc taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.353134] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.353371] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.353371] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.353488] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('def9aa42-470d-498e-9034-6879fb1e6ebc',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1358.390465] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.390709] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.390709] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.390878] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.399526] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.399753] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.401143] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.401248] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.402119] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.402230] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.402567] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.402664] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.410694] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.410826] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e54f39e-349d-49ad-bb07-348488d846f0 is going to be deleted. [ 1358.411710] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.411938] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.429493] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.429679] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8004bc6e-552e-4ff4-87f0-242b54bbfb5d is going to be deleted. [ 1358.430547] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.430769] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.454478] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.454614] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 28809bb1-c80b-4696-9980-5f00f47130bb is going to be deleted. [ 1358.455524] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.455737] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.475892] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.476076] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2db7d87e-43a6-451c-9080-385c174466ee is going to be deleted. [ 1358.476924] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.477149] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.591264] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.591486] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.595764] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.595923] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.598608] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.598753] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.602230] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.602355] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e is going to be deleted. [ 1358.603239] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.603455] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.603540] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.603665] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e54f39e-349d-49ad-bb07-348488d846f0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.604365] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.604454] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.604523] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.604690] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.604769] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.604884] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8004bc6e-552e-4ff4-87f0-242b54bbfb5d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.605022] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.605175] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.605251] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.605361] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-28809bb1-c80b-4696-9980-5f00f47130bb" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.605849] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.606094] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.606260] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.606440] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2db7d87e-43a6-451c-9080-385c174466ee" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.776529] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.776785] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.776785] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.776964] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.777116] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.777182] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57a9b7ef-9e6b-4f97-bf9c-e5e430c8c98e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.855422] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6d86fb6-2897-4e0b-8601-d87ed7fe208e taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.855422] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6d86fb6-2897-4e0b-8601-d87ed7fe208e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.855422] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6d86fb6-2897-4e0b-8601-d87ed7fe208e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.855422] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6d86fb6-2897-4e0b-8601-d87ed7fe208e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.855603] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.855809] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.855901] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.856107] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.856287] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.856439] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6d86fb6-2897-4e0b-8601-d87ed7fe208e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.856561] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b6d86fb6-2897-4e0b-8601-d87ed7fe208e',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1358.861211] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-a034d096-40a8-4ee7-8cb1-e9d03d795d6a taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.861358] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a034d096-40a8-4ee7-8cb1-e9d03d795d6a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.861499] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a034d096-40a8-4ee7-8cb1-e9d03d795d6a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.861770] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a034d096-40a8-4ee7-8cb1-e9d03d795d6a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.861993] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.862099] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.862166] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.862328] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.862414] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.862503] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a034d096-40a8-4ee7-8cb1-e9d03d795d6a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.862592] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a034d096-40a8-4ee7-8cb1-e9d03d795d6a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1358.870433] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-def9aa42-470d-498e-9034-6879fb1e6ebc taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.870626] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.870626] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.870879] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.871060] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.871200] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.871250] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.871416] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.871505] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.871592] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.871704] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('def9aa42-470d-498e-9034-6879fb1e6ebc',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1358.977401] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.977605] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.977605] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.977843] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.979608] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.979740] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.980451] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.980547] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.981193] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.981284] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.988192] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.988352] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.988989] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.989096] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.998173] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.998173] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.998756] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.998854] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.999642] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.999746] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.000414] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.000509] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.001165] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.001278] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.001908] env[70614]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1359.002406] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.002406] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.046943] env[70614]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1359.047521] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.047654] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d141340f-d099-4b67-88b0-348423856ab2 is going to be deleted. [ 1359.048595] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.048815] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.095464] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.095599] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 81470f34-f44d-4111-b9a8-fc43c119e1dd is going to be deleted. [ 1359.097054] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.097054] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.364958] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a034d096-40a8-4ee7-8cb1-e9d03d795d6a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1359.365986] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b6d86fb6-2897-4e0b-8601-d87ed7fe208e',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1359.380936] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('def9aa42-470d-498e-9034-6879fb1e6ebc',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1359.404379] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.404559] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1 is going to be deleted. [ 1359.405694] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.405921] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.532460] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.532711] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e717c4b-1f67-4d20-9afd-677fdceb923a is going to be deleted. [ 1359.533540] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.533758] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.536707] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.536831] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.542612] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.542763] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.558269] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.558467] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.584143] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.584312] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e23923e3-0ade-47cf-aa89-03f9a991b3f7 is going to be deleted. [ 1359.585242] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.585465] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.637645] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.637810] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3177f360-f74b-456a-9c1b-681726056f53 is going to be deleted. [ 1359.638677] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.638895] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.681399] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.681626] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.695297] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.695485] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f58ad372-72ca-472a-aab5-8b86e9d2f1e6 is going to be deleted. [ 1359.696364] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.696592] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.700207] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.700351] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.725231] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.725414] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca55d9c7-11be-476b-bdb5-63e4c956a4de is going to be deleted. [ 1359.726327] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.726549] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.784938] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.785170] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 03fa4ca9-532b-43b0-bd53-de11eea0a016 is going to be deleted. [ 1359.786072] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.786292] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.808466] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.808692] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.810600] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.810770] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.811774] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.811906] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.862395] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.862613] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca853b04-ee44-46f5-a78c-096d9284c247 is going to be deleted. [ 1359.863509] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.863732] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.867260] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a034d096-40a8-4ee7-8cb1-e9d03d795d6a: rpc.has_security_group_logging(os_id): False [ 1359.868197] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b6d86fb6-2897-4e0b-8601-d87ed7fe208e: rpc.has_security_group_logging(os_id): False [ 1359.882773] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for def9aa42-470d-498e-9034-6879fb1e6ebc: rpc.has_security_group_logging(os_id): False [ 1359.901920] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.902156] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.912971] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.913204] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 31d51b9f-24c2-407d-92f6-bfa0a20cfef8 is going to be deleted. [ 1359.914075] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.914310] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.916033] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.916153] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.916843] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.916937] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.937018] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.937233] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.001111] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.001327] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b55beff3-0092-4844-958f-ed6f6ef8b108 is going to be deleted. [ 1360.002333] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.002561] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.002679] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.002833] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d141340f-d099-4b67-88b0-348423856ab2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.002997] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.003183] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.003264] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.003378] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9bdd1eb5-68f5-4fde-b0cf-bc1e43f582a1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.003932] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.004102] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.004180] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.004308] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-81470f34-f44d-4111-b9a8-fc43c119e1dd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.004423] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.004563] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.004640] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.004779] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e717c4b-1f67-4d20-9afd-677fdceb923a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.004914] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.005107] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.005215] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.005300] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e23923e3-0ade-47cf-aa89-03f9a991b3f7" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.005429] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.005566] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.005639] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.005749] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3177f360-f74b-456a-9c1b-681726056f53" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.005875] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.006029] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.006108] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.006222] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f58ad372-72ca-472a-aab5-8b86e9d2f1e6" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.006349] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.006510] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.006594] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.006712] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca55d9c7-11be-476b-bdb5-63e4c956a4de" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.006867] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.007014] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.034151] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.034377] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.035156] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.035281] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.060333] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.060648] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.060752] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.060817] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.061052] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.061137] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.061232] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a034d096-40a8-4ee7-8cb1-e9d03d795d6a is going to be updated. [ 1360.062356] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.062534] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.113503] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.113813] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.113942] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.114009] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.114188] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.114269] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.114364] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: def9aa42-470d-498e-9034-6879fb1e6ebc is going to be updated. [ 1360.115491] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.115664] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.115763] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.115858] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-03fa4ca9-532b-43b0-bd53-de11eea0a016" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.115985] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.116142] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.116302] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.116375] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca853b04-ee44-46f5-a78c-096d9284c247" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.116452] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.116783] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.116783] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.116783] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-31d51b9f-24c2-407d-92f6-bfa0a20cfef8" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.116874] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.116978] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.162234] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.162479] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.162595] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.162665] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.162882] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.162982] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.163053] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b6d86fb6-2897-4e0b-8601-d87ed7fe208e is going to be updated. [ 1360.186099] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.186386] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.186477] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.186812] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.186966] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.187265] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b55beff3-0092-4844-958f-ed6f6ef8b108" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.217724] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.217958] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.217958] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.218149] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.218288] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.252529] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.252757] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.253068] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.253068] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.253172] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.255131] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: def9aa42-470d-498e-9034-6879fb1e6ebc in Status: IN_PROGRESS for 2s [ 1360.273857] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a034d096-40a8-4ee7-8cb1-e9d03d795d6a in Status: IN_PROGRESS for 2s [ 1360.313512] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.313731] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.313731] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.313919] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.314082] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.354963] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b6d86fb6-2897-4e0b-8601-d87ed7fe208e in Status: IN_PROGRESS for 2s [ 1362.268103] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: def9aa42-470d-498e-9034-6879fb1e6ebc in Status: SUCCESS [ 1362.268578] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.285142] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a034d096-40a8-4ee7-8cb1-e9d03d795d6a in Status: SUCCESS [ 1362.285383] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a034d096-40a8-4ee7-8cb1-e9d03d795d6a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.367454] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b6d86fb6-2897-4e0b-8601-d87ed7fe208e in Status: SUCCESS [ 1362.367737] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b6d86fb6-2897-4e0b-8601-d87ed7fe208e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.332766] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1363.333199] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1368.334493] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1368.334880] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1373.335672] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1373.336100] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1378.336590] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1378.336590] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1383.337777] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1383.338198] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1387.502765] env[70614]: INFO networking_nsxv3.common.synchronization [None req-f99b72fc-f093-435f-8dcb-4a3396b87ad8 tempest-AttachVolumeNegativeTest-1085254203 tempest-AttachVolumeNegativeTest-1085254203-project-member] Enqueued Resource ID: 2f835b02-0885-4d88-8d2d-4a47ba0a1993 with Priority: HIGHEST for action security_group_rules [ 1387.503308] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f835b02-0885-4d88-8d2d-4a47ba0a1993 with Priority: HIGHEST for action security_group_rules [ 1387.503608] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f835b02-0885-4d88-8d2d-4a47ba0a1993 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.503768] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f835b02-0885-4d88-8d2d-4a47ba0a1993" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.503882] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f835b02-0885-4d88-8d2d-4a47ba0a1993" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.505321] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f835b02-0885-4d88-8d2d-4a47ba0a1993" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.505321] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f835b02-0885-4d88-8d2d-4a47ba0a1993',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1387.574192] env[70614]: INFO networking_nsxv3.common.synchronization [None req-aa21a5d7-2e99-42a1-8af6-06b8991c7d3f tempest-AttachVolumeNegativeTest-1085254203 tempest-AttachVolumeNegativeTest-1085254203-project-member] Enqueued Resource ID: 2f835b02-0885-4d88-8d2d-4a47ba0a1993 with Priority: HIGHEST for action security_group_rules [ 1387.574700] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f835b02-0885-4d88-8d2d-4a47ba0a1993 with Priority: HIGHEST for action security_group_rules [ 1387.575008] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f835b02-0885-4d88-8d2d-4a47ba0a1993 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.575119] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f835b02-0885-4d88-8d2d-4a47ba0a1993" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.024318] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.024546] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.024546] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.024831] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.024974] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.025148] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f835b02-0885-4d88-8d2d-4a47ba0a1993 already deleted. [ 1388.025262] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f835b02-0885-4d88-8d2d-4a47ba0a1993" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.025438] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f835b02-0885-4d88-8d2d-4a47ba0a1993" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.025623] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f835b02-0885-4d88-8d2d-4a47ba0a1993" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.025743] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f835b02-0885-4d88-8d2d-4a47ba0a1993',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1388.546030] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.546435] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.546435] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.546435] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.546567] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.546604] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f835b02-0885-4d88-8d2d-4a47ba0a1993 already deleted. [ 1388.546666] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f835b02-0885-4d88-8d2d-4a47ba0a1993" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.519470] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-657 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.519859] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-657" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.519859] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-657" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.520122] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-657" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.520682] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.520682] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.520860] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.520947] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.521091] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.521308] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1390.521425] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1390.521536] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1390.521643] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1390.521752] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1390.521886] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1390.522052] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1390.553590] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1390.553809] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1390.553927] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1390.554085] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-657" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.554472] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-a2233698-ae14-48c7-83ac-600772a63eda taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.554652] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-a2233698-ae14-48c7-83ac-600772a63eda" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.554779] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-a2233698-ae14-48c7-83ac-600772a63eda" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.555081] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-a2233698-ae14-48c7-83ac-600772a63eda" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.555230] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2233698-ae14-48c7-83ac-600772a63eda',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1391.058352] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.058612] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.058849] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.059198] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.059385] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.059718] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.059927] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.060093] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.060328] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.060567] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.060853] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.061105] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.061244] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.061460] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.061616] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.061790] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: a2233698-ae14-48c7-83ac-600772a63eda is going to be updated. [ 1391.084069] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.084258] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.084372] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.084638] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.084830] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.085058] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-a2233698-ae14-48c7-83ac-600772a63eda" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.769145] env[70614]: INFO networking_nsxv3.common.synchronization [req-97c7d4a7-2a60-4ac1-b6b5-f847173bd377 req-a0119657-d808-48c9-9aca-cb7c2f3dfe89 service nova] Enqueued Resource ID: b6d86fb6-2897-4e0b-8601-d87ed7fe208e with Priority: HIGHEST for action security_group_rules [ 1391.769412] env[70614]: INFO networking_nsxv3.common.synchronization [req-97c7d4a7-2a60-4ac1-b6b5-f847173bd377 req-a0119657-d808-48c9-9aca-cb7c2f3dfe89 service nova] Enqueued Resource ID: b6d86fb6-2897-4e0b-8601-d87ed7fe208e with Priority: HIGHEST for action security_group_members [ 1391.769475] env[70614]: INFO networking_nsxv3.common.synchronization [req-97c7d4a7-2a60-4ac1-b6b5-f847173bd377 req-a0119657-d808-48c9-9aca-cb7c2f3dfe89 service nova] Enqueued Resource ID: a2233698-ae14-48c7-83ac-600772a63eda with Priority: HIGHEST for action port [ 1391.769718] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6d86fb6-2897-4e0b-8601-d87ed7fe208e with Priority: HIGHEST for action security_group_rules [ 1391.769883] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6d86fb6-2897-4e0b-8601-d87ed7fe208e with Priority: HIGHEST for action security_group_members [ 1391.769998] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2233698-ae14-48c7-83ac-600772a63eda with Priority: HIGHEST for action port [ 1391.770579] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b6d86fb6-2897-4e0b-8601-d87ed7fe208e taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.770738] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b6d86fb6-2897-4e0b-8601-d87ed7fe208e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.770786] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b6d86fb6-2897-4e0b-8601-d87ed7fe208e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.771016] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b6d86fb6-2897-4e0b-8601-d87ed7fe208e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.771274] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b6d86fb6-2897-4e0b-8601-d87ed7fe208e',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1391.772932] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6d86fb6-2897-4e0b-8601-d87ed7fe208e taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.772932] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6d86fb6-2897-4e0b-8601-d87ed7fe208e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.772932] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6d86fb6-2897-4e0b-8601-d87ed7fe208e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.772932] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6d86fb6-2897-4e0b-8601-d87ed7fe208e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.772932] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.772932] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.772932] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.772932] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.772932] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.773325] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b6d86fb6-2897-4e0b-8601-d87ed7fe208e',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1391.774120] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-a2233698-ae14-48c7-83ac-600772a63eda taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.774201] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a2233698-ae14-48c7-83ac-600772a63eda" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.774424] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a2233698-ae14-48c7-83ac-600772a63eda" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.774424] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a2233698-ae14-48c7-83ac-600772a63eda" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.774424] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2233698-ae14-48c7-83ac-600772a63eda',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.277389] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b6d86fb6-2897-4e0b-8601-d87ed7fe208e',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.278537] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6d86fb6-2897-4e0b-8601-d87ed7fe208e taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.278656] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6d86fb6-2897-4e0b-8601-d87ed7fe208e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.278839] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a2233698-ae14-48c7-83ac-600772a63eda with status ACTIVE [ 1392.278994] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.279113] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.279174] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.279380] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.279466] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.279636] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.279748] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.279793] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.279946] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.280079] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.280313] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.280417] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.280482] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.280710] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.280791] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.280884] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a2233698-ae14-48c7-83ac-600772a63eda is going to be updated. [ 1392.301652] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.301931] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.301931] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.302141] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.302282] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.302432] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a2233698-ae14-48c7-83ac-600772a63eda" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.784232] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b6d86fb6-2897-4e0b-8601-d87ed7fe208e',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1393.187050] env[70614]: INFO networking_nsxv3.common.synchronization [req-53e4196d-6940-4bad-8e08-968cba1e101e req-71f0d3de-8f48-44a9-91e5-92fbcb9962f3 tempest-AttachVolumeNegativeTest-1085254203 tempest-AttachVolumeNegativeTest-1085254203-project-member] Enqueued Resource ID: 2f835b02-0885-4d88-8d2d-4a47ba0a1993 with Priority: HIGHEST for action security_group_members [ 1393.187695] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f835b02-0885-4d88-8d2d-4a47ba0a1993 with Priority: HIGHEST for action security_group_members [ 1393.188081] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f835b02-0885-4d88-8d2d-4a47ba0a1993 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.188231] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f835b02-0885-4d88-8d2d-4a47ba0a1993" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.188315] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f835b02-0885-4d88-8d2d-4a47ba0a1993" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.188588] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f835b02-0885-4d88-8d2d-4a47ba0a1993" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.188790] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.188969] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.189049] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.189196] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.189297] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.189412] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f835b02-0885-4d88-8d2d-4a47ba0a1993',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1393.287404] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.287404] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.287404] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.287687] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.287720] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.287853] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6d86fb6-2897-4e0b-8601-d87ed7fe208e is going to be updated. [ 1393.320919] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.321225] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.321225] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.321527] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.321747] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.333243] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6d86fb6-2897-4e0b-8601-d87ed7fe208e in Status: IN_PROGRESS for 2s [ 1393.471691] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-574 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.471942] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-574" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.472108] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-574" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.472391] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-574" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.472657] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.472817] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.472955] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.473201] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.473351] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.473567] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1393.473683] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1393.473795] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1393.473906] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1393.474029] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1393.474272] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1393.474453] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1393.497702] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1393.497881] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1393.498036] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1393.498215] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-574" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.498559] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-6522ff32-caf2-43c0-bd48-d19fa7079a4a taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.498740] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-6522ff32-caf2-43c0-bd48-d19fa7079a4a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.498867] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-6522ff32-caf2-43c0-bd48-d19fa7079a4a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.499264] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-6522ff32-caf2-43c0-bd48-d19fa7079a4a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.499427] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6522ff32-caf2-43c0-bd48-d19fa7079a4a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1393.692058] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.692372] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.692592] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.692978] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.693062] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.693511] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.693511] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.693511] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.693682] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.693721] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.693795] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f835b02-0885-4d88-8d2d-4a47ba0a1993 already deleted. [ 1393.694389] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f835b02-0885-4d88-8d2d-4a47ba0a1993" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.002696] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.003080] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.003281] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.003579] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.003737] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.003905] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 6522ff32-caf2-43c0-bd48-d19fa7079a4a not found, creating... [ 1394.004198] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.004361] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.004482] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.004713] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.004856] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.005164] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.005330] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.005526] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.005652] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.005791] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.005934] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 6522ff32-caf2-43c0-bd48-d19fa7079a4a is going to be created. [ 1394.025766] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.025766] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.025766] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.025766] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.026121] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.026261] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-6522ff32-caf2-43c0-bd48-d19fa7079a4a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.684932] env[70614]: INFO networking_nsxv3.common.synchronization [req-53e4196d-6940-4bad-8e08-968cba1e101e req-a7225700-0ed4-432c-b961-0bcba4fec36b service nova] Enqueued Resource ID: 2f835b02-0885-4d88-8d2d-4a47ba0a1993 with Priority: HIGHEST for action security_group_rules [ 1394.685140] env[70614]: INFO networking_nsxv3.common.synchronization [req-53e4196d-6940-4bad-8e08-968cba1e101e req-a7225700-0ed4-432c-b961-0bcba4fec36b service nova] Enqueued Resource ID: 2f835b02-0885-4d88-8d2d-4a47ba0a1993 with Priority: HIGHEST for action security_group_members [ 1394.685281] env[70614]: INFO networking_nsxv3.common.synchronization [req-53e4196d-6940-4bad-8e08-968cba1e101e req-a7225700-0ed4-432c-b961-0bcba4fec36b service nova] Enqueued Resource ID: 6522ff32-caf2-43c0-bd48-d19fa7079a4a with Priority: HIGHEST for action port [ 1394.685500] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f835b02-0885-4d88-8d2d-4a47ba0a1993 with Priority: HIGHEST for action security_group_rules [ 1394.685674] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f835b02-0885-4d88-8d2d-4a47ba0a1993 with Priority: HIGHEST for action security_group_members [ 1394.685732] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6522ff32-caf2-43c0-bd48-d19fa7079a4a with Priority: HIGHEST for action port [ 1394.687269] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f835b02-0885-4d88-8d2d-4a47ba0a1993 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.687408] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f835b02-0885-4d88-8d2d-4a47ba0a1993" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.687471] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f835b02-0885-4d88-8d2d-4a47ba0a1993" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.687676] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f835b02-0885-4d88-8d2d-4a47ba0a1993" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.687758] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f835b02-0885-4d88-8d2d-4a47ba0a1993',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1394.688733] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f835b02-0885-4d88-8d2d-4a47ba0a1993 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.688852] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f835b02-0885-4d88-8d2d-4a47ba0a1993" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.688912] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f835b02-0885-4d88-8d2d-4a47ba0a1993" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.689361] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f835b02-0885-4d88-8d2d-4a47ba0a1993" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.689361] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.689361] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.689530] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.689530] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.689656] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.689710] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f835b02-0885-4d88-8d2d-4a47ba0a1993',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1394.690488] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-6522ff32-caf2-43c0-bd48-d19fa7079a4a taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.690625] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6522ff32-caf2-43c0-bd48-d19fa7079a4a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.690681] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6522ff32-caf2-43c0-bd48-d19fa7079a4a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.690793] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6522ff32-caf2-43c0-bd48-d19fa7079a4a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.690860] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6522ff32-caf2-43c0-bd48-d19fa7079a4a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1395.192918] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2f835b02-0885-4d88-8d2d-4a47ba0a1993',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1395.194149] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f835b02-0885-4d88-8d2d-4a47ba0a1993 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.194304] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f835b02-0885-4d88-8d2d-4a47ba0a1993" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.194693] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6522ff32-caf2-43c0-bd48-d19fa7079a4a with status ACTIVE [ 1395.194859] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.194967] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.195048] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.195245] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.195332] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.195495] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.195588] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.195645] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.195796] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.196680] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.196680] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.196680] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.196680] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.196680] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.196680] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.196680] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6522ff32-caf2-43c0-bd48-d19fa7079a4a is going to be updated. [ 1395.217772] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.217984] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.217984] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.218192] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.218333] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.218490] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6522ff32-caf2-43c0-bd48-d19fa7079a4a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.347379] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6d86fb6-2897-4e0b-8601-d87ed7fe208e in Status: SUCCESS [ 1395.347591] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6d86fb6-2897-4e0b-8601-d87ed7fe208e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.347748] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6d86fb6-2897-4e0b-8601-d87ed7fe208e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.347970] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6d86fb6-2897-4e0b-8601-d87ed7fe208e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.348169] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.348282] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.348369] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.348493] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.348743] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.348843] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6d86fb6-2897-4e0b-8601-d87ed7fe208e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.348917] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b6d86fb6-2897-4e0b-8601-d87ed7fe208e',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1395.695237] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2f835b02-0885-4d88-8d2d-4a47ba0a1993',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1395.851251] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b6d86fb6-2897-4e0b-8601-d87ed7fe208e',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1396.198320] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.198753] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.198753] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.198848] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.198977] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.199102] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f835b02-0885-4d88-8d2d-4a47ba0a1993 is going to be created. [ 1396.238071] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.238071] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.238071] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.238071] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.238071] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.248705] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f835b02-0885-4d88-8d2d-4a47ba0a1993 in Status: UNINITIALIZED for 2s [ 1396.356195] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b6d86fb6-2897-4e0b-8601-d87ed7fe208e: rpc.has_security_group_logging(os_id): False [ 1396.375234] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.375443] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.375496] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.375774] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.375869] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.376178] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.376319] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.376411] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.376600] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.376705] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.376822] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b6d86fb6-2897-4e0b-8601-d87ed7fe208e is going to be updated. [ 1396.445499] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.445725] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.445725] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.445927] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.446169] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.464584] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b6d86fb6-2897-4e0b-8601-d87ed7fe208e in Status: IN_PROGRESS for 2s [ 1398.261781] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f835b02-0885-4d88-8d2d-4a47ba0a1993 in Status: SUCCESS [ 1398.262190] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f835b02-0885-4d88-8d2d-4a47ba0a1993" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.262407] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f835b02-0885-4d88-8d2d-4a47ba0a1993" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.262659] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f835b02-0885-4d88-8d2d-4a47ba0a1993" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.262836] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.262968] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.263068] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.263219] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.263366] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.263619] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f835b02-0885-4d88-8d2d-4a47ba0a1993" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.263932] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2f835b02-0885-4d88-8d2d-4a47ba0a1993',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1398.482247] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b6d86fb6-2897-4e0b-8601-d87ed7fe208e in Status: SUCCESS [ 1398.482517] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b6d86fb6-2897-4e0b-8601-d87ed7fe208e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.767169] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2f835b02-0885-4d88-8d2d-4a47ba0a1993',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1399.270410] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2f835b02-0885-4d88-8d2d-4a47ba0a1993: rpc.has_security_group_logging(os_id): False [ 1399.289182] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.289446] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.289446] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.289619] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.289716] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.290108] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.290254] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.290328] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.290496] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.290576] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.290671] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f835b02-0885-4d88-8d2d-4a47ba0a1993 is going to be created. [ 1399.355297] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.355558] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.355618] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.355841] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.356042] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.367982] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f835b02-0885-4d88-8d2d-4a47ba0a1993 in Status: IN_PROGRESS for 2s [ 1399.687153] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1399.687283] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1400.968440] env[70614]: INFO networking_nsxv3.common.synchronization [req-d74c4961-45a6-4a34-9355-344c268a9f38 req-df9f949e-d30b-4f0c-b657-db96d5a589b2 tempest-ServerActionsTestJSON-366333930 tempest-ServerActionsTestJSON-366333930-project-member] Enqueued Resource ID: def9aa42-470d-498e-9034-6879fb1e6ebc with Priority: HIGHEST for action security_group_members [ 1400.968440] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: def9aa42-470d-498e-9034-6879fb1e6ebc with Priority: HIGHEST for action security_group_members [ 1400.968763] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-def9aa42-470d-498e-9034-6879fb1e6ebc taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.968763] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.968893] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.969083] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.969234] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.969330] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.969459] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.969512] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.969579] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.969669] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('def9aa42-470d-498e-9034-6879fb1e6ebc',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1401.382891] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f835b02-0885-4d88-8d2d-4a47ba0a1993 in Status: SUCCESS [ 1401.383154] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f835b02-0885-4d88-8d2d-4a47ba0a1993" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.473112] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1401.473379] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1401.473379] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.473599] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.473707] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.474028] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1401.474136] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1401.474194] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.474356] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.474436] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.474525] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: def9aa42-470d-498e-9034-6879fb1e6ebc is going to be updated. [ 1401.508298] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1401.508560] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1401.508560] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.508861] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.509106] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.521560] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: def9aa42-470d-498e-9034-6879fb1e6ebc in Status: IN_PROGRESS for 2s [ 1403.532927] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: def9aa42-470d-498e-9034-6879fb1e6ebc in Status: SUCCESS [ 1403.532927] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: def9aa42-470d-498e-9034-6879fb1e6ebc deletion is rescheduled due to dependency. [ 1403.532927] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.968885] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1405.968885] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1408.681156] env[70614]: INFO networking_nsxv3.common.synchronization [None req-3b15909f-9354-49cc-8850-a1827bf8e2a8 None None] Enqueued Resource ID: 93fe7d17-2ceb-4c92-9b02-b4b0745604f3 with Priority: HIGHEST for action port [ 1408.682018] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93fe7d17-2ceb-4c92-9b02-b4b0745604f3 with Priority: HIGHEST for action port [ 1408.688088] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-93fe7d17-2ceb-4c92-9b02-b4b0745604f3 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.688330] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-93fe7d17-2ceb-4c92-9b02-b4b0745604f3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.688425] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-93fe7d17-2ceb-4c92-9b02-b4b0745604f3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.688824] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-93fe7d17-2ceb-4c92-9b02-b4b0745604f3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.688974] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('93fe7d17-2ceb-4c92-9b02-b4b0745604f3',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1409.192069] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 93fe7d17-2ceb-4c92-9b02-b4b0745604f3 [ 1409.192237] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.192352] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.192352] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.192867] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.192867] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.192867] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:93fe7d17-2ceb-4c92-9b02-b4b0745604f3 already deleted. [ 1409.192867] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-93fe7d17-2ceb-4c92-9b02-b4b0745604f3" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.933325] env[70614]: INFO networking_nsxv3.common.synchronization [None req-263e4407-3b0b-464a-87d1-609510e160d7 None None] Enqueued Resource ID: fb47c1fd-dea3-409b-a5fe-23f74cafc0ad with Priority: HIGHEST for action port [ 1410.933640] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb47c1fd-dea3-409b-a5fe-23f74cafc0ad with Priority: HIGHEST for action port [ 1410.934156] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb47c1fd-dea3-409b-a5fe-23f74cafc0ad taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.934293] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb47c1fd-dea3-409b-a5fe-23f74cafc0ad" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.934352] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb47c1fd-dea3-409b-a5fe-23f74cafc0ad" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.934694] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb47c1fd-dea3-409b-a5fe-23f74cafc0ad" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.934763] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb47c1fd-dea3-409b-a5fe-23f74cafc0ad',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1411.436511] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fb47c1fd-dea3-409b-a5fe-23f74cafc0ad [ 1411.436716] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.436852] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.436920] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.437170] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.437261] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.437397] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fb47c1fd-dea3-409b-a5fe-23f74cafc0ad already deleted. [ 1411.437489] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb47c1fd-dea3-409b-a5fe-23f74cafc0ad" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.265345] env[70614]: INFO networking_nsxv3.common.synchronization [req-fc48de4a-dda1-4ee7-aafb-0088101c4eeb req-9b0f56b5-ffd0-4cee-a36b-df1ccb57e196 tempest-ServerRescueTestJSONUnderV235-1217818143 tempest-ServerRescueTestJSONUnderV235-1217818143-project-member] Enqueued Resource ID: 99e15af7-6cdc-4609-a788-d8c9a88491b2 with Priority: HIGHEST for action security_group_members [ 1414.266239] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99e15af7-6cdc-4609-a788-d8c9a88491b2 with Priority: HIGHEST for action security_group_members [ 1414.266722] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-99e15af7-6cdc-4609-a788-d8c9a88491b2 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.266927] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99e15af7-6cdc-4609-a788-d8c9a88491b2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.267074] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99e15af7-6cdc-4609-a788-d8c9a88491b2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.267451] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99e15af7-6cdc-4609-a788-d8c9a88491b2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.267697] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.267866] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.267977] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.268243] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.268392] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.268547] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99e15af7-6cdc-4609-a788-d8c9a88491b2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1414.528638] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-852 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.528811] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-852" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.528811] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-852" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.529131] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-852" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.529433] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.529562] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.529662] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.529876] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.530036] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.530260] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1414.530376] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1414.530490] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1414.530596] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1414.530707] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1414.530815] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1414.530950] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1414.552533] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1414.552734] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1414.552856] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1414.553029] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-852" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.553362] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-b19cb580-71cc-4cde-8a45-304e05d7efcc taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.553541] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-b19cb580-71cc-4cde-8a45-304e05d7efcc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.553666] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-b19cb580-71cc-4cde-8a45-304e05d7efcc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.554011] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-b19cb580-71cc-4cde-8a45-304e05d7efcc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.554165] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b19cb580-71cc-4cde-8a45-304e05d7efcc',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1414.771548] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.771800] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.771800] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.771987] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.772146] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.772359] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.772461] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.772517] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.772676] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.772753] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.772837] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99e15af7-6cdc-4609-a788-d8c9a88491b2 already deleted. [ 1414.772916] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99e15af7-6cdc-4609-a788-d8c9a88491b2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.056988] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.056988] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.056988] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.057324] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.057561] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.057764] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port b19cb580-71cc-4cde-8a45-304e05d7efcc not found, creating... [ 1415.058117] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.058231] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.058353] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.058579] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.058719] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.058999] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.059269] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.059426] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.059669] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.059848] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.060353] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: b19cb580-71cc-4cde-8a45-304e05d7efcc is going to be created. [ 1415.079568] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.079852] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.080045] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.080316] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.080590] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.080846] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-b19cb580-71cc-4cde-8a45-304e05d7efcc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.751766] env[70614]: INFO networking_nsxv3.common.synchronization [req-fc48de4a-dda1-4ee7-aafb-0088101c4eeb req-9185361a-f1ed-44a0-ba70-fd35d3610d67 service nova] Enqueued Resource ID: 99e15af7-6cdc-4609-a788-d8c9a88491b2 with Priority: HIGHEST for action security_group_rules [ 1415.752083] env[70614]: INFO networking_nsxv3.common.synchronization [req-fc48de4a-dda1-4ee7-aafb-0088101c4eeb req-9185361a-f1ed-44a0-ba70-fd35d3610d67 service nova] Enqueued Resource ID: 99e15af7-6cdc-4609-a788-d8c9a88491b2 with Priority: HIGHEST for action security_group_members [ 1415.752246] env[70614]: INFO networking_nsxv3.common.synchronization [req-fc48de4a-dda1-4ee7-aafb-0088101c4eeb req-9185361a-f1ed-44a0-ba70-fd35d3610d67 service nova] Enqueued Resource ID: b19cb580-71cc-4cde-8a45-304e05d7efcc with Priority: HIGHEST for action port [ 1415.752374] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99e15af7-6cdc-4609-a788-d8c9a88491b2 with Priority: HIGHEST for action security_group_rules [ 1415.752501] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99e15af7-6cdc-4609-a788-d8c9a88491b2 with Priority: HIGHEST for action security_group_members [ 1415.752599] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b19cb580-71cc-4cde-8a45-304e05d7efcc with Priority: HIGHEST for action port [ 1415.753234] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-99e15af7-6cdc-4609-a788-d8c9a88491b2 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.753341] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-99e15af7-6cdc-4609-a788-d8c9a88491b2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.753396] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-99e15af7-6cdc-4609-a788-d8c9a88491b2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.753644] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-99e15af7-6cdc-4609-a788-d8c9a88491b2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.753734] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('99e15af7-6cdc-4609-a788-d8c9a88491b2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1415.754581] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-99e15af7-6cdc-4609-a788-d8c9a88491b2 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.755232] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99e15af7-6cdc-4609-a788-d8c9a88491b2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.755232] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99e15af7-6cdc-4609-a788-d8c9a88491b2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.755232] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99e15af7-6cdc-4609-a788-d8c9a88491b2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.755232] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.755232] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.755562] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.755562] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.755562] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.755562] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99e15af7-6cdc-4609-a788-d8c9a88491b2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1415.756665] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-b19cb580-71cc-4cde-8a45-304e05d7efcc taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.756793] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b19cb580-71cc-4cde-8a45-304e05d7efcc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.756882] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b19cb580-71cc-4cde-8a45-304e05d7efcc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.756988] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b19cb580-71cc-4cde-8a45-304e05d7efcc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.757083] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b19cb580-71cc-4cde-8a45-304e05d7efcc',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1416.258517] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-99e15af7-6cdc-4609-a788-d8c9a88491b2 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1416.258661] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99e15af7-6cdc-4609-a788-d8c9a88491b2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1416.258856] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('99e15af7-6cdc-4609-a788-d8c9a88491b2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1416.259812] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b19cb580-71cc-4cde-8a45-304e05d7efcc with status ACTIVE [ 1416.259999] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1416.260163] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1416.260231] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1416.260421] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1416.260523] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1416.260697] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1416.260804] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1416.260891] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1416.261128] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1416.261219] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1416.261403] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1416.261499] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1416.261561] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1416.261704] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1416.261779] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1416.261862] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b19cb580-71cc-4cde-8a45-304e05d7efcc is going to be updated. [ 1416.283288] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1416.283533] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1416.283533] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1416.283702] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1416.283840] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1416.283994] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b19cb580-71cc-4cde-8a45-304e05d7efcc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1416.764384] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('99e15af7-6cdc-4609-a788-d8c9a88491b2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1417.267013] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1417.267201] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1417.267278] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1417.267508] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1417.267599] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1417.267698] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99e15af7-6cdc-4609-a788-d8c9a88491b2 is going to be created. [ 1417.290130] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1417.290349] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1417.290349] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1417.290521] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1417.290675] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1417.300162] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99e15af7-6cdc-4609-a788-d8c9a88491b2 in Status: UNINITIALIZED for 2s [ 1419.311284] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99e15af7-6cdc-4609-a788-d8c9a88491b2 in Status: SUCCESS [ 1419.311702] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99e15af7-6cdc-4609-a788-d8c9a88491b2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.311702] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99e15af7-6cdc-4609-a788-d8c9a88491b2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1419.311870] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99e15af7-6cdc-4609-a788-d8c9a88491b2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1419.312118] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.312235] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.312300] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1419.312459] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1419.312537] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.312624] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99e15af7-6cdc-4609-a788-d8c9a88491b2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.312717] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('99e15af7-6cdc-4609-a788-d8c9a88491b2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1419.815253] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-99e15af7-6cdc-4609-a788-d8c9a88491b2 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.815520] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99e15af7-6cdc-4609-a788-d8c9a88491b2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.815520] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99e15af7-6cdc-4609-a788-d8c9a88491b2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1419.815693] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99e15af7-6cdc-4609-a788-d8c9a88491b2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1419.815870] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.815962] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.816041] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1419.816334] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1419.816473] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.816578] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99e15af7-6cdc-4609-a788-d8c9a88491b2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.816747] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-99e15af7-6cdc-4609-a788-d8c9a88491b2 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.816851] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99e15af7-6cdc-4609-a788-d8c9a88491b2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.816917] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99e15af7-6cdc-4609-a788-d8c9a88491b2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1419.817100] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99e15af7-6cdc-4609-a788-d8c9a88491b2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1419.817246] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.817345] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.817408] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1419.817553] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1419.817633] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.817720] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99e15af7-6cdc-4609-a788-d8c9a88491b2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.817810] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('99e15af7-6cdc-4609-a788-d8c9a88491b2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1420.320240] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 99e15af7-6cdc-4609-a788-d8c9a88491b2: rpc.has_security_group_logging(os_id): False [ 1420.338594] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.338817] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.338817] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1420.339041] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1420.339139] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1420.339362] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.339464] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.339520] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1420.339674] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1420.339750] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1420.339917] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.340088] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.340148] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1420.340267] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1420.340340] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1420.340525] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.340621] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.340686] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1420.340810] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1420.340892] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1420.340980] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 99e15af7-6cdc-4609-a788-d8c9a88491b2 is going to be created. [ 1420.397914] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.398197] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.398197] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1420.398355] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1420.398533] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1420.409390] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 99e15af7-6cdc-4609-a788-d8c9a88491b2 in Status: IN_PROGRESS for 2s [ 1420.753464] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1420.753708] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1422.423709] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 99e15af7-6cdc-4609-a788-d8c9a88491b2 in Status: SUCCESS [ 1422.423709] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-99e15af7-6cdc-4609-a788-d8c9a88491b2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1425.754766] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1425.755190] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1430.756044] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1430.756318] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1431.209182] env[70614]: INFO networking_nsxv3.common.synchronization [req-c544fe0f-1b87-42f5-8819-9ff54035bc26 req-dd493d9a-08d2-446e-b056-d99227d5634e tempest-ServerRescueTestJSONUnderV235-1217818143 tempest-ServerRescueTestJSONUnderV235-1217818143-project-member] Enqueued Resource ID: 99e15af7-6cdc-4609-a788-d8c9a88491b2 with Priority: HIGHEST for action security_group_members [ 1431.209182] env[70614]: INFO networking_nsxv3.common.synchronization [req-c544fe0f-1b87-42f5-8819-9ff54035bc26 req-dd493d9a-08d2-446e-b056-d99227d5634e tempest-ServerRescueTestJSONUnderV235-1217818143 tempest-ServerRescueTestJSONUnderV235-1217818143-project-member] Enqueued Resource ID: 766f5b69-b26e-40b6-bd6b-fb1287f7a761 with Priority: HIGHEST for action security_group_members [ 1431.209691] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99e15af7-6cdc-4609-a788-d8c9a88491b2 with Priority: HIGHEST for action security_group_members [ 1431.209825] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 766f5b69-b26e-40b6-bd6b-fb1287f7a761 with Priority: HIGHEST for action security_group_members [ 1431.210130] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-99e15af7-6cdc-4609-a788-d8c9a88491b2 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.210256] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99e15af7-6cdc-4609-a788-d8c9a88491b2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.210322] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99e15af7-6cdc-4609-a788-d8c9a88491b2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.210520] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99e15af7-6cdc-4609-a788-d8c9a88491b2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.210670] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.210766] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.210827] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.210967] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.211062] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1431.211153] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99e15af7-6cdc-4609-a788-d8c9a88491b2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1431.211940] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-766f5b69-b26e-40b6-bd6b-fb1287f7a761 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.212059] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-766f5b69-b26e-40b6-bd6b-fb1287f7a761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.212164] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-766f5b69-b26e-40b6-bd6b-fb1287f7a761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.212866] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-766f5b69-b26e-40b6-bd6b-fb1287f7a761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.212866] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.212866] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.212866] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.212866] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.212866] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1431.213171] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('766f5b69-b26e-40b6-bd6b-fb1287f7a761',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1431.250479] env[70614]: INFO networking_nsxv3.common.synchronization [req-c544fe0f-1b87-42f5-8819-9ff54035bc26 req-dd493d9a-08d2-446e-b056-d99227d5634e tempest-ServerRescueTestJSONUnderV235-1217818143 tempest-ServerRescueTestJSONUnderV235-1217818143-project-member] Enqueued Resource ID: 766f5b69-b26e-40b6-bd6b-fb1287f7a761 with Priority: HIGHEST for action security_group_rules [ 1431.250667] env[70614]: INFO networking_nsxv3.common.synchronization [req-c544fe0f-1b87-42f5-8819-9ff54035bc26 req-dd493d9a-08d2-446e-b056-d99227d5634e tempest-ServerRescueTestJSONUnderV235-1217818143 tempest-ServerRescueTestJSONUnderV235-1217818143-project-member] Enqueued Resource ID: 766f5b69-b26e-40b6-bd6b-fb1287f7a761 with Priority: HIGHEST for action security_group_members [ 1431.250808] env[70614]: INFO networking_nsxv3.common.synchronization [req-c544fe0f-1b87-42f5-8819-9ff54035bc26 req-dd493d9a-08d2-446e-b056-d99227d5634e tempest-ServerRescueTestJSONUnderV235-1217818143 tempest-ServerRescueTestJSONUnderV235-1217818143-project-member] Enqueued Resource ID: 99e15af7-6cdc-4609-a788-d8c9a88491b2 with Priority: HIGHEST for action security_group_rules [ 1431.250940] env[70614]: INFO networking_nsxv3.common.synchronization [req-c544fe0f-1b87-42f5-8819-9ff54035bc26 req-dd493d9a-08d2-446e-b056-d99227d5634e tempest-ServerRescueTestJSONUnderV235-1217818143 tempest-ServerRescueTestJSONUnderV235-1217818143-project-member] Enqueued Resource ID: 99e15af7-6cdc-4609-a788-d8c9a88491b2 with Priority: HIGHEST for action security_group_members [ 1431.251085] env[70614]: INFO networking_nsxv3.common.synchronization [req-c544fe0f-1b87-42f5-8819-9ff54035bc26 req-dd493d9a-08d2-446e-b056-d99227d5634e tempest-ServerRescueTestJSONUnderV235-1217818143 tempest-ServerRescueTestJSONUnderV235-1217818143-project-member] Enqueued Resource ID: b19cb580-71cc-4cde-8a45-304e05d7efcc with Priority: HIGHEST for action port [ 1431.251537] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 766f5b69-b26e-40b6-bd6b-fb1287f7a761 with Priority: HIGHEST for action security_group_rules [ 1431.251678] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99e15af7-6cdc-4609-a788-d8c9a88491b2 with Priority: HIGHEST for action security_group_rules [ 1431.251774] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b19cb580-71cc-4cde-8a45-304e05d7efcc with Priority: HIGHEST for action port [ 1431.251867] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 766f5b69-b26e-40b6-bd6b-fb1287f7a761 with Priority: HIGHEST for action security_group_members [ 1431.251954] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99e15af7-6cdc-4609-a788-d8c9a88491b2 with Priority: HIGHEST for action security_group_members [ 1431.252261] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-766f5b69-b26e-40b6-bd6b-fb1287f7a761 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.252376] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-766f5b69-b26e-40b6-bd6b-fb1287f7a761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.252446] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-766f5b69-b26e-40b6-bd6b-fb1287f7a761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.252691] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-766f5b69-b26e-40b6-bd6b-fb1287f7a761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.252771] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('766f5b69-b26e-40b6-bd6b-fb1287f7a761',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1431.254052] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-99e15af7-6cdc-4609-a788-d8c9a88491b2 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.254233] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-99e15af7-6cdc-4609-a788-d8c9a88491b2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.254233] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-99e15af7-6cdc-4609-a788-d8c9a88491b2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.254393] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-99e15af7-6cdc-4609-a788-d8c9a88491b2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.254470] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('99e15af7-6cdc-4609-a788-d8c9a88491b2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1431.255193] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-b19cb580-71cc-4cde-8a45-304e05d7efcc taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.255279] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b19cb580-71cc-4cde-8a45-304e05d7efcc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.255362] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b19cb580-71cc-4cde-8a45-304e05d7efcc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.255491] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b19cb580-71cc-4cde-8a45-304e05d7efcc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.255564] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b19cb580-71cc-4cde-8a45-304e05d7efcc',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1431.256220] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-766f5b69-b26e-40b6-bd6b-fb1287f7a761 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.256314] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-766f5b69-b26e-40b6-bd6b-fb1287f7a761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.256494] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-99e15af7-6cdc-4609-a788-d8c9a88491b2 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.256575] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99e15af7-6cdc-4609-a788-d8c9a88491b2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.493194] env[70614]: INFO networking_nsxv3.common.synchronization [req-2a429506-41e1-43cb-a86d-c58bf48a2834 req-e8a4be00-914e-4474-983c-6627fc16d3e7 tempest-ServerRescueTestJSONUnderV235-1217818143 tempest-ServerRescueTestJSONUnderV235-1217818143-project-member] Enqueued Resource ID: 99e15af7-6cdc-4609-a788-d8c9a88491b2 with Priority: HIGHEST for action security_group_members [ 1431.493386] env[70614]: INFO networking_nsxv3.common.synchronization [req-2a429506-41e1-43cb-a86d-c58bf48a2834 req-e8a4be00-914e-4474-983c-6627fc16d3e7 tempest-ServerRescueTestJSONUnderV235-1217818143 tempest-ServerRescueTestJSONUnderV235-1217818143-project-member] Enqueued Resource ID: 766f5b69-b26e-40b6-bd6b-fb1287f7a761 with Priority: HIGHEST for action security_group_members [ 1431.493866] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99e15af7-6cdc-4609-a788-d8c9a88491b2 with Priority: HIGHEST for action security_group_members [ 1431.494032] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 766f5b69-b26e-40b6-bd6b-fb1287f7a761 with Priority: HIGHEST for action security_group_members [ 1431.494274] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-99e15af7-6cdc-4609-a788-d8c9a88491b2 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.494362] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99e15af7-6cdc-4609-a788-d8c9a88491b2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.494538] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-766f5b69-b26e-40b6-bd6b-fb1287f7a761 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.494620] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-766f5b69-b26e-40b6-bd6b-fb1287f7a761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.534509] env[70614]: INFO networking_nsxv3.common.synchronization [req-2a429506-41e1-43cb-a86d-c58bf48a2834 req-e8a4be00-914e-4474-983c-6627fc16d3e7 tempest-ServerRescueTestJSONUnderV235-1217818143 tempest-ServerRescueTestJSONUnderV235-1217818143-project-member] Enqueued Resource ID: 99e15af7-6cdc-4609-a788-d8c9a88491b2 with Priority: HIGHEST for action security_group_rules [ 1431.534710] env[70614]: INFO networking_nsxv3.common.synchronization [req-2a429506-41e1-43cb-a86d-c58bf48a2834 req-e8a4be00-914e-4474-983c-6627fc16d3e7 tempest-ServerRescueTestJSONUnderV235-1217818143 tempest-ServerRescueTestJSONUnderV235-1217818143-project-member] Enqueued Resource ID: 99e15af7-6cdc-4609-a788-d8c9a88491b2 with Priority: HIGHEST for action security_group_members [ 1431.534855] env[70614]: INFO networking_nsxv3.common.synchronization [req-2a429506-41e1-43cb-a86d-c58bf48a2834 req-e8a4be00-914e-4474-983c-6627fc16d3e7 tempest-ServerRescueTestJSONUnderV235-1217818143 tempest-ServerRescueTestJSONUnderV235-1217818143-project-member] Enqueued Resource ID: b19cb580-71cc-4cde-8a45-304e05d7efcc with Priority: HIGHEST for action port [ 1431.535312] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99e15af7-6cdc-4609-a788-d8c9a88491b2 with Priority: HIGHEST for action security_group_rules [ 1431.535445] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99e15af7-6cdc-4609-a788-d8c9a88491b2 with Priority: HIGHEST for action security_group_members [ 1431.535539] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b19cb580-71cc-4cde-8a45-304e05d7efcc with Priority: HIGHEST for action port [ 1431.535801] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-99e15af7-6cdc-4609-a788-d8c9a88491b2 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.535903] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-99e15af7-6cdc-4609-a788-d8c9a88491b2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.536164] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-99e15af7-6cdc-4609-a788-d8c9a88491b2 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.536253] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99e15af7-6cdc-4609-a788-d8c9a88491b2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.536442] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-b19cb580-71cc-4cde-8a45-304e05d7efcc taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.536513] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b19cb580-71cc-4cde-8a45-304e05d7efcc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.718623] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('99e15af7-6cdc-4609-a788-d8c9a88491b2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1431.718623] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('766f5b69-b26e-40b6-bd6b-fb1287f7a761',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1431.757651] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b19cb580-71cc-4cde-8a45-304e05d7efcc with status ACTIVE [ 1431.758235] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.758235] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.758235] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.758594] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.758690] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1431.758963] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.759101] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.759176] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.759410] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.759532] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1431.759803] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.759956] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.760067] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.760295] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.760415] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1431.760552] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b19cb580-71cc-4cde-8a45-304e05d7efcc is going to be updated. [ 1431.761963] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-99e15af7-6cdc-4609-a788-d8c9a88491b2 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.761963] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99e15af7-6cdc-4609-a788-d8c9a88491b2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.762227] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-766f5b69-b26e-40b6-bd6b-fb1287f7a761 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.762360] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-766f5b69-b26e-40b6-bd6b-fb1287f7a761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.783886] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.784113] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.784113] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.784312] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.784465] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1431.784653] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b19cb580-71cc-4cde-8a45-304e05d7efcc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1431.784805] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b19cb580-71cc-4cde-8a45-304e05d7efcc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.784963] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b19cb580-71cc-4cde-8a45-304e05d7efcc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.785066] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b19cb580-71cc-4cde-8a45-304e05d7efcc',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1432.217283] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('99e15af7-6cdc-4609-a788-d8c9a88491b2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1432.218342] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('766f5b69-b26e-40b6-bd6b-fb1287f7a761',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1432.287484] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b19cb580-71cc-4cde-8a45-304e05d7efcc with status ACTIVE [ 1432.287702] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1432.288077] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1432.288077] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1432.288293] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1432.288384] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1432.288570] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1432.288670] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1432.288724] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1432.288865] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1432.289091] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1432.289163] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1432.289216] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1432.289283] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1432.289392] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1432.289463] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1432.289546] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b19cb580-71cc-4cde-8a45-304e05d7efcc is going to be updated. [ 1432.310613] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1432.310796] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1432.310838] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1432.311019] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1432.311283] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1432.311367] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b19cb580-71cc-4cde-8a45-304e05d7efcc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1432.720814] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1432.721188] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1432.721188] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1432.721496] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1432.721654] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1432.721817] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99e15af7-6cdc-4609-a788-d8c9a88491b2 is going to be updated. [ 1432.723313] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1432.723463] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1432.723599] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1432.723804] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1432.723927] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1432.724087] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 766f5b69-b26e-40b6-bd6b-fb1287f7a761 is going to be created. [ 1432.752839] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1432.753117] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1432.753117] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1432.753308] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1432.753451] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1432.757341] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1432.757578] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1432.757578] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1432.757762] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1432.757979] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1432.765194] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 766f5b69-b26e-40b6-bd6b-fb1287f7a761 in Status: UNINITIALIZED for 2s [ 1432.765834] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99e15af7-6cdc-4609-a788-d8c9a88491b2 in Status: IN_PROGRESS for 2s [ 1434.776376] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 766f5b69-b26e-40b6-bd6b-fb1287f7a761 in Status: SUCCESS [ 1434.776850] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-766f5b69-b26e-40b6-bd6b-fb1287f7a761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.777296] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99e15af7-6cdc-4609-a788-d8c9a88491b2 in Status: SUCCESS [ 1434.777458] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99e15af7-6cdc-4609-a788-d8c9a88491b2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.777604] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-766f5b69-b26e-40b6-bd6b-fb1287f7a761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.777813] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-766f5b69-b26e-40b6-bd6b-fb1287f7a761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.777991] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.778114] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.778178] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.778374] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.778499] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.778630] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('766f5b69-b26e-40b6-bd6b-fb1287f7a761',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1434.779456] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99e15af7-6cdc-4609-a788-d8c9a88491b2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.779620] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99e15af7-6cdc-4609-a788-d8c9a88491b2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.779774] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.779876] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.779939] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.780086] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.780183] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.780278] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99e15af7-6cdc-4609-a788-d8c9a88491b2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1435.282264] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1435.282476] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1435.282524] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.282718] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.282803] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.283009] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1435.283124] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1435.283187] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.283377] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.283475] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.283580] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 766f5b69-b26e-40b6-bd6b-fb1287f7a761 is going to be deleted. [ 1435.284586] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('99e15af7-6cdc-4609-a788-d8c9a88491b2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1435.313009] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1435.313168] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1435.313224] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.313441] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.313527] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.313627] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-766f5b69-b26e-40b6-bd6b-fb1287f7a761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.313824] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-766f5b69-b26e-40b6-bd6b-fb1287f7a761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.314015] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-766f5b69-b26e-40b6-bd6b-fb1287f7a761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.314175] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1435.314275] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1435.314337] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.314474] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.314551] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.314639] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('766f5b69-b26e-40b6-bd6b-fb1287f7a761',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1435.786975] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('99e15af7-6cdc-4609-a788-d8c9a88491b2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1435.816738] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1435.816923] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1435.816966] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.817188] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.817280] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.817474] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1435.817601] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1435.817666] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.817819] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.817895] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.817981] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 766f5b69-b26e-40b6-bd6b-fb1287f7a761 already deleted. [ 1435.818070] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-766f5b69-b26e-40b6-bd6b-fb1287f7a761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.818214] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-766f5b69-b26e-40b6-bd6b-fb1287f7a761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.818362] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-766f5b69-b26e-40b6-bd6b-fb1287f7a761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.818506] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1435.818593] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1435.818651] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.818786] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.818858] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.818946] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('766f5b69-b26e-40b6-bd6b-fb1287f7a761',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1436.203186] env[70614]: INFO networking_nsxv3.common.synchronization [req-7b638352-392c-443d-9f4d-a697d3418b19 req-6aaed789-d31d-4ae5-a895-0756afc78906 tempest-ServerRescueTestJSONUnderV235-1217818143 tempest-ServerRescueTestJSONUnderV235-1217818143-project-member] Enqueued Resource ID: 99e15af7-6cdc-4609-a788-d8c9a88491b2 with Priority: HIGHEST for action security_group_members [ 1436.203781] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99e15af7-6cdc-4609-a788-d8c9a88491b2 with Priority: HIGHEST for action security_group_members [ 1436.204147] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-99e15af7-6cdc-4609-a788-d8c9a88491b2 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.204255] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99e15af7-6cdc-4609-a788-d8c9a88491b2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.290084] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.290084] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.290084] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.290379] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.290379] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.290450] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99e15af7-6cdc-4609-a788-d8c9a88491b2 is going to be updated. [ 1436.319235] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.319431] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.319481] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.319657] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.319802] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.321422] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.321544] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.321612] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.321793] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.321875] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.322269] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.322420] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.322466] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.323012] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.323012] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.323012] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 766f5b69-b26e-40b6-bd6b-fb1287f7a761 already deleted. [ 1436.323012] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-766f5b69-b26e-40b6-bd6b-fb1287f7a761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.323012] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('766f5b69-b26e-40b6-bd6b-fb1287f7a761',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1436.332453] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99e15af7-6cdc-4609-a788-d8c9a88491b2 in Status: IN_PROGRESS for 2s [ 1436.824916] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('766f5b69-b26e-40b6-bd6b-fb1287f7a761',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1437.327981] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 766f5b69-b26e-40b6-bd6b-fb1287f7a761: rpc.has_security_group_logging(os_id): False [ 1437.346209] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.346415] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.346415] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.346640] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.346730] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.346923] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.347029] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.347100] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.347237] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.347312] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.347402] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 766f5b69-b26e-40b6-bd6b-fb1287f7a761 is going to be created. [ 1437.376200] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/766f5b69-b26e-40b6-bd6b-fb1287f7a761], does not exist path=[/infra/domains/default/groups/766f5b69-b26e-40b6-bd6b-fb1287f7a761]."\n}' [ 1437.376416] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 766f5b69-b26e-40b6-bd6b-fb1287f7a761 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/766f5b69-b26e-40b6-bd6b-fb1287f7a761 [ 1437.376416] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1437.407043] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.407282] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.407282] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.407456] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.408179] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.408416] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.408522] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.408587] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.408746] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.408823] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.408985] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.409092] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.409153] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.409295] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.409370] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.409451] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 766f5b69-b26e-40b6-bd6b-fb1287f7a761 is going to be created. [ 1437.424337] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/766f5b69-b26e-40b6-bd6b-fb1287f7a761], does not exist path=[/infra/domains/default/groups/766f5b69-b26e-40b6-bd6b-fb1287f7a761]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/766f5b69-b26e-40b6-bd6b-fb1287f7a761 [ 1437.424531] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-766f5b69-b26e-40b6-bd6b-fb1287f7a761" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.424647] env[70614]: Traceback (most recent call last): [ 1437.424702] env[70614]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 1437.424702] env[70614]: return func(*args, **kwargs) [ 1437.424702] env[70614]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1437.424702] env[70614]: res.raise_for_status() [ 1437.424702] env[70614]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 1437.424702] env[70614]: raise HTTPError(http_error_msg, response=self) [ 1437.424702] env[70614]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/766f5b69-b26e-40b6-bd6b-fb1287f7a761 [ 1437.424702] env[70614]: During handling of the above exception, another exception occurred: [ 1437.424702] env[70614]: Traceback (most recent call last): [ 1437.424702] env[70614]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 1437.424702] env[70614]: listener.cb(fileno) [ 1437.424702] env[70614]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 1437.424702] env[70614]: result = function(*args, **kwargs) [ 1437.424702] env[70614]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 1437.424702] env[70614]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 1437.424702] env[70614]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 1437.424702] env[70614]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 1437.424702] env[70614]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 1437.424702] env[70614]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 1437.424702] env[70614]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1437.424702] env[70614]: res.raise_for_status() [ 1437.424702] env[70614]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 1437.424702] env[70614]: raise HTTPError(http_error_msg, response=self) [ 1437.424702] env[70614]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/766f5b69-b26e-40b6-bd6b-fb1287f7a761 [ 1437.425501] env[70614]: Removing descriptor: 19 [ 1438.342534] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99e15af7-6cdc-4609-a788-d8c9a88491b2 in Status: SUCCESS [ 1438.342851] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99e15af7-6cdc-4609-a788-d8c9a88491b2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1438.342851] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99e15af7-6cdc-4609-a788-d8c9a88491b2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1438.344058] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99e15af7-6cdc-4609-a788-d8c9a88491b2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1438.344058] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1438.344058] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1438.344058] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1438.344058] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1438.344058] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1438.344058] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99e15af7-6cdc-4609-a788-d8c9a88491b2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1438.846131] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1438.846131] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1438.846458] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1438.846458] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1438.866879] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1438.867148] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1438.867269] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1438.867329] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1438.867543] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1438.867652] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1438.867704] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99e15af7-6cdc-4609-a788-d8c9a88491b2 is going to be updated. [ 1438.892401] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1438.892619] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1438.892619] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1438.892803] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1438.892945] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1438.901294] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99e15af7-6cdc-4609-a788-d8c9a88491b2 in Status: IN_PROGRESS for 2s [ 1440.911821] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99e15af7-6cdc-4609-a788-d8c9a88491b2 in Status: SUCCESS [ 1440.912283] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99e15af7-6cdc-4609-a788-d8c9a88491b2 deletion is rescheduled due to dependency. [ 1440.912283] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99e15af7-6cdc-4609-a788-d8c9a88491b2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1440.912283] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99e15af7-6cdc-4609-a788-d8c9a88491b2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1440.912503] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99e15af7-6cdc-4609-a788-d8c9a88491b2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1440.912685] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1440.912800] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1440.912863] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1440.913017] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1440.913095] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1440.913219] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99e15af7-6cdc-4609-a788-d8c9a88491b2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1441.205299] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1441.205471] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=4 [ 1441.415894] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1441.416229] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1441.416229] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1441.416358] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1441.416443] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1441.416670] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1441.416773] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1441.416835] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1441.417076] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1441.417229] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1441.417229] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99e15af7-6cdc-4609-a788-d8c9a88491b2 is going to be updated. [ 1441.445872] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1441.446084] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1441.446192] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1441.446312] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1441.446456] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1441.455496] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99e15af7-6cdc-4609-a788-d8c9a88491b2 in Status: IN_PROGRESS for 2s [ 1441.956480] env[70614]: INFO networking_nsxv3.common.synchronization [req-1a5bbcc8-6896-4636-ae47-a336bf23c08e req-b9189994-ac80-4a11-bbe9-6168d5bba50b tempest-AttachVolumeNegativeTest-1085254203 tempest-AttachVolumeNegativeTest-1085254203-project-member] Enqueued Resource ID: 2f835b02-0885-4d88-8d2d-4a47ba0a1993 with Priority: HIGHEST for action security_group_members [ 1441.956960] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f835b02-0885-4d88-8d2d-4a47ba0a1993 with Priority: HIGHEST for action security_group_members [ 1441.957300] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f835b02-0885-4d88-8d2d-4a47ba0a1993 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1441.957442] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f835b02-0885-4d88-8d2d-4a47ba0a1993" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1441.957509] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f835b02-0885-4d88-8d2d-4a47ba0a1993" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1441.957704] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f835b02-0885-4d88-8d2d-4a47ba0a1993" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1441.957853] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1441.957966] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1441.958181] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1441.958412] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1441.958551] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1441.958685] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f835b02-0885-4d88-8d2d-4a47ba0a1993',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1442.460962] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1442.461220] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1442.461265] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1442.461517] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1442.482027] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1442.482336] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1442.482463] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1442.482525] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1442.482729] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1442.482809] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1442.482899] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f835b02-0885-4d88-8d2d-4a47ba0a1993 is going to be updated. [ 1442.507836] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1442.508053] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1442.508053] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1442.508253] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1442.508398] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1442.517424] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f835b02-0885-4d88-8d2d-4a47ba0a1993 in Status: IN_PROGRESS for 2s [ 1443.465791] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99e15af7-6cdc-4609-a788-d8c9a88491b2 in Status: SUCCESS [ 1443.466214] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99e15af7-6cdc-4609-a788-d8c9a88491b2 deletion is rescheduled due to dependency. [ 1443.466214] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99e15af7-6cdc-4609-a788-d8c9a88491b2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1443.466309] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99e15af7-6cdc-4609-a788-d8c9a88491b2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1443.466469] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99e15af7-6cdc-4609-a788-d8c9a88491b2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1443.466866] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1443.466998] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1443.467133] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1443.467244] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1443.467345] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1443.467447] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99e15af7-6cdc-4609-a788-d8c9a88491b2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1443.467546] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('99e15af7-6cdc-4609-a788-d8c9a88491b2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1443.468419] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99e15af7-6cdc-4609-a788-d8c9a88491b2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1443.468563] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99e15af7-6cdc-4609-a788-d8c9a88491b2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1443.468725] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1443.468827] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1443.468891] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1443.469056] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1443.469133] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1443.469222] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99e15af7-6cdc-4609-a788-d8c9a88491b2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1443.970843] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('99e15af7-6cdc-4609-a788-d8c9a88491b2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1443.974357] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1443.974357] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1443.974357] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1443.974701] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1443.974701] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1443.974839] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1443.974995] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1443.974995] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1443.975122] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1443.975164] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1443.975249] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99e15af7-6cdc-4609-a788-d8c9a88491b2 is going to be updated. [ 1443.998508] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1443.998651] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1443.998723] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1443.998920] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1443.999365] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1444.007548] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99e15af7-6cdc-4609-a788-d8c9a88491b2 in Status: IN_PROGRESS for 2s [ 1444.477547] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 99e15af7-6cdc-4609-a788-d8c9a88491b2: rpc.has_security_group_logging(os_id): False [ 1444.494921] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1444.495093] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1444.495145] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1444.495354] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1444.495443] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1444.495638] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1444.495734] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1444.495795] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1444.495940] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1444.496028] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1444.496116] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 99e15af7-6cdc-4609-a788-d8c9a88491b2 is going to be updated. [ 1444.525637] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f835b02-0885-4d88-8d2d-4a47ba0a1993 in Status: SUCCESS [ 1444.525850] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f835b02-0885-4d88-8d2d-4a47ba0a1993 deletion is rescheduled due to dependency. [ 1444.525942] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f835b02-0885-4d88-8d2d-4a47ba0a1993" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1444.552149] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1444.552411] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1444.552463] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1444.552648] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1444.552788] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1444.567127] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 99e15af7-6cdc-4609-a788-d8c9a88491b2 in Status: IN_PROGRESS for 2s [ 1446.017802] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99e15af7-6cdc-4609-a788-d8c9a88491b2 in Status: SUCCESS [ 1446.018263] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99e15af7-6cdc-4609-a788-d8c9a88491b2 deletion is rescheduled due to dependency. [ 1446.018263] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99e15af7-6cdc-4609-a788-d8c9a88491b2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1446.579985] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 99e15af7-6cdc-4609-a788-d8c9a88491b2 in Status: SUCCESS [ 1446.580265] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-99e15af7-6cdc-4609-a788-d8c9a88491b2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1446.580434] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-99e15af7-6cdc-4609-a788-d8c9a88491b2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1446.580656] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-99e15af7-6cdc-4609-a788-d8c9a88491b2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1446.580748] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('99e15af7-6cdc-4609-a788-d8c9a88491b2',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1446.958303] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1446.958495] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1447.102028] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1447.102028] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1447.102028] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1447.102028] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1447.116936] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1447.117114] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 99e15af7-6cdc-4609-a788-d8c9a88491b2 is going to be deleted. [ 1447.157293] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1447.157550] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1447.157550] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1447.157755] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1447.157821] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1447.157873] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-99e15af7-6cdc-4609-a788-d8c9a88491b2" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1450.061991] env[70614]: INFO networking_nsxv3.common.synchronization [req-bb80607c-0334-4501-a667-98ea454be8d6 req-06a389ee-9667-4766-9d7f-1e73dbbb7f60 tempest-AttachVolumeShelveTestJSON-232337985 tempest-AttachVolumeShelveTestJSON-232337985-project-member] Enqueued Resource ID: b6d86fb6-2897-4e0b-8601-d87ed7fe208e with Priority: HIGHEST for action security_group_members [ 1450.062197] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6d86fb6-2897-4e0b-8601-d87ed7fe208e with Priority: HIGHEST for action security_group_members [ 1450.062403] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6d86fb6-2897-4e0b-8601-d87ed7fe208e taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1450.062536] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6d86fb6-2897-4e0b-8601-d87ed7fe208e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1450.062604] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6d86fb6-2897-4e0b-8601-d87ed7fe208e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1450.062795] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6d86fb6-2897-4e0b-8601-d87ed7fe208e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1450.062947] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1450.063183] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1450.063271] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1450.063420] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1450.063505] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1450.063596] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b6d86fb6-2897-4e0b-8601-d87ed7fe208e',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1450.566439] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1450.566680] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1450.566680] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1450.566901] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1450.589274] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1450.589537] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1450.589655] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1450.589940] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1450.589940] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1450.590069] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1450.590107] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6d86fb6-2897-4e0b-8601-d87ed7fe208e is going to be updated. [ 1450.614330] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1450.614510] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1450.614510] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1450.614704] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1450.614843] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1450.630435] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6d86fb6-2897-4e0b-8601-d87ed7fe208e in Status: IN_PROGRESS for 2s [ 1452.862905] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6d86fb6-2897-4e0b-8601-d87ed7fe208e in Status: SUCCESS [ 1452.863288] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6d86fb6-2897-4e0b-8601-d87ed7fe208e deletion is rescheduled due to dependency. [ 1452.863344] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6d86fb6-2897-4e0b-8601-d87ed7fe208e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1454.226692] env[70614]: INFO networking_nsxv3.common.synchronization [req-1cb733ab-a4bc-4468-a77b-0efa66631fe2 req-e3ded00c-b390-4ca9-9358-47d5a019cda0 tempest-AttachVolumeNegativeTest-1085254203 tempest-AttachVolumeNegativeTest-1085254203-project-member] Enqueued Resource ID: a034d096-40a8-4ee7-8cb1-e9d03d795d6a with Priority: HIGHEST for action security_group_members [ 1454.227188] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a034d096-40a8-4ee7-8cb1-e9d03d795d6a with Priority: HIGHEST for action security_group_members [ 1454.227624] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-a034d096-40a8-4ee7-8cb1-e9d03d795d6a taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1454.227759] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a034d096-40a8-4ee7-8cb1-e9d03d795d6a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1454.227759] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a034d096-40a8-4ee7-8cb1-e9d03d795d6a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1454.227945] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a034d096-40a8-4ee7-8cb1-e9d03d795d6a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1454.228117] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1454.229039] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1454.229135] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1454.229359] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1454.229463] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1454.229576] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a034d096-40a8-4ee7-8cb1-e9d03d795d6a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1454.733950] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1454.733950] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1454.733950] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1454.733950] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1454.753749] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1454.754328] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1454.755510] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1454.755510] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1454.755510] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1454.755510] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1454.755510] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a034d096-40a8-4ee7-8cb1-e9d03d795d6a is going to be updated. [ 1454.767545] env[70614]: INFO networking_nsxv3.common.synchronization [None req-4545f4d2-4572-4684-af5d-70de08e877c6 tempest-AttachVolumeShelveTestJSON-232337985 tempest-AttachVolumeShelveTestJSON-232337985-project-member] Enqueued Resource ID: 822e878a-4ff6-4b05-bb6e-6fa1772d2841 with Priority: HIGHEST for action security_group_rules [ 1454.767813] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 822e878a-4ff6-4b05-bb6e-6fa1772d2841 with Priority: HIGHEST for action security_group_rules [ 1454.768368] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-822e878a-4ff6-4b05-bb6e-6fa1772d2841 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1454.768485] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-822e878a-4ff6-4b05-bb6e-6fa1772d2841" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1454.768545] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-822e878a-4ff6-4b05-bb6e-6fa1772d2841" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1454.768825] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-822e878a-4ff6-4b05-bb6e-6fa1772d2841" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1454.768910] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('822e878a-4ff6-4b05-bb6e-6fa1772d2841',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1454.782499] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1454.782669] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1454.782737] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1454.782895] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1454.783049] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1454.792244] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a034d096-40a8-4ee7-8cb1-e9d03d795d6a in Status: IN_PROGRESS for 2s [ 1454.851870] env[70614]: INFO networking_nsxv3.common.synchronization [None req-6803b508-5c65-4acc-99eb-9c92e89802c7 tempest-AttachVolumeShelveTestJSON-232337985 tempest-AttachVolumeShelveTestJSON-232337985-project-member] Enqueued Resource ID: 822e878a-4ff6-4b05-bb6e-6fa1772d2841 with Priority: HIGHEST for action security_group_rules [ 1454.852451] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 822e878a-4ff6-4b05-bb6e-6fa1772d2841 with Priority: HIGHEST for action security_group_rules [ 1454.852810] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-822e878a-4ff6-4b05-bb6e-6fa1772d2841 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1454.852919] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-822e878a-4ff6-4b05-bb6e-6fa1772d2841" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1455.289847] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1455.289847] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1455.289847] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1455.290371] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1455.290371] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1455.290371] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 822e878a-4ff6-4b05-bb6e-6fa1772d2841 already deleted. [ 1455.290371] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-822e878a-4ff6-4b05-bb6e-6fa1772d2841" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1455.290520] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-822e878a-4ff6-4b05-bb6e-6fa1772d2841" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1455.290647] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-822e878a-4ff6-4b05-bb6e-6fa1772d2841" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1455.290737] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('822e878a-4ff6-4b05-bb6e-6fa1772d2841',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1455.811052] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1455.811052] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1455.811052] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1455.811052] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1455.811052] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1455.811052] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 822e878a-4ff6-4b05-bb6e-6fa1772d2841 already deleted. [ 1455.811052] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-822e878a-4ff6-4b05-bb6e-6fa1772d2841" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1456.802362] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a034d096-40a8-4ee7-8cb1-e9d03d795d6a in Status: SUCCESS [ 1456.802764] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a034d096-40a8-4ee7-8cb1-e9d03d795d6a deletion is rescheduled due to dependency. [ 1456.802825] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a034d096-40a8-4ee7-8cb1-e9d03d795d6a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1459.136247] env[70614]: INFO networking_nsxv3.common.synchronization [None req-d2f1eb04-d946-410e-a0a3-e6b3321c094a tempest-AttachVolumeNegativeTest-1085254203 tempest-AttachVolumeNegativeTest-1085254203-project-member] Enqueued Resource ID: 60333446-97ce-4f78-835e-24cf4d7aaf23 with Priority: HIGHEST for action security_group_rules [ 1459.136687] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60333446-97ce-4f78-835e-24cf4d7aaf23 with Priority: HIGHEST for action security_group_rules [ 1459.136981] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-60333446-97ce-4f78-835e-24cf4d7aaf23 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1459.137123] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-60333446-97ce-4f78-835e-24cf4d7aaf23" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1459.137182] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-60333446-97ce-4f78-835e-24cf4d7aaf23" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1459.137485] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-60333446-97ce-4f78-835e-24cf4d7aaf23" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1459.137636] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('60333446-97ce-4f78-835e-24cf4d7aaf23',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1459.203761] env[70614]: INFO networking_nsxv3.common.synchronization [None req-bfc5074a-cb04-4772-a8f3-3da33046be4a tempest-AttachVolumeNegativeTest-1085254203 tempest-AttachVolumeNegativeTest-1085254203-project-member] Enqueued Resource ID: 60333446-97ce-4f78-835e-24cf4d7aaf23 with Priority: HIGHEST for action security_group_rules [ 1459.203988] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60333446-97ce-4f78-835e-24cf4d7aaf23 with Priority: HIGHEST for action security_group_rules [ 1459.204533] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-60333446-97ce-4f78-835e-24cf4d7aaf23 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1459.204705] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-60333446-97ce-4f78-835e-24cf4d7aaf23" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1459.658820] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1459.659017] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1459.659063] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1459.659431] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1459.659577] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1459.659734] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 60333446-97ce-4f78-835e-24cf4d7aaf23 already deleted. [ 1459.659856] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-60333446-97ce-4f78-835e-24cf4d7aaf23" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1459.660072] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-60333446-97ce-4f78-835e-24cf4d7aaf23" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1459.660272] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-60333446-97ce-4f78-835e-24cf4d7aaf23" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1459.660413] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('60333446-97ce-4f78-835e-24cf4d7aaf23',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1460.179578] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.179966] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.179966] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1460.180059] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1460.180112] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1460.180215] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 60333446-97ce-4f78-835e-24cf4d7aaf23 already deleted. [ 1460.180287] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-60333446-97ce-4f78-835e-24cf4d7aaf23" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1460.459495] env[70614]: INFO networking_nsxv3.common.synchronization [req-8edc8f1e-416f-4f9b-9a9c-49bd906f0fae req-cd20941f-6582-4c1a-84ea-8b20a5e4bd3f tempest-AttachVolumeShelveTestJSON-232337985 tempest-AttachVolumeShelveTestJSON-232337985-project-member] Enqueued Resource ID: 822e878a-4ff6-4b05-bb6e-6fa1772d2841 with Priority: HIGHEST for action security_group_members [ 1460.460111] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 822e878a-4ff6-4b05-bb6e-6fa1772d2841 with Priority: HIGHEST for action security_group_members [ 1460.460495] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-822e878a-4ff6-4b05-bb6e-6fa1772d2841 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.460633] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-822e878a-4ff6-4b05-bb6e-6fa1772d2841" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.460701] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-822e878a-4ff6-4b05-bb6e-6fa1772d2841" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1460.460983] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-822e878a-4ff6-4b05-bb6e-6fa1772d2841" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1460.461204] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.461329] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.461438] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1460.461644] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1460.461760] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1460.461903] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('822e878a-4ff6-4b05-bb6e-6fa1772d2841',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1460.699520] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-657 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.699804] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-657" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.699970] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-657" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1460.700308] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-657" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1460.700639] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.700838] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.700991] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1460.701256] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1460.701434] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1460.701682] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1460.701829] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1460.701978] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1460.702135] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1460.702289] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1460.702496] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1460.702666] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1460.723903] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1460.724092] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1460.724239] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1460.724417] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-657" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1460.724737] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-10f26e0c-bbb8-4c94-9aa4-be74e7de2091 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.724913] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-10f26e0c-bbb8-4c94-9aa4-be74e7de2091" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.725053] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-10f26e0c-bbb8-4c94-9aa4-be74e7de2091" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1460.725391] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-10f26e0c-bbb8-4c94-9aa4-be74e7de2091" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1460.725536] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10f26e0c-bbb8-4c94-9aa4-be74e7de2091',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1460.967832] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.968025] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.968142] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1460.968380] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1460.968427] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1460.968604] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.968703] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.968766] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1460.968913] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1460.969020] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1460.969074] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 822e878a-4ff6-4b05-bb6e-6fa1772d2841 already deleted. [ 1460.969154] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-822e878a-4ff6-4b05-bb6e-6fa1772d2841" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.228303] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.228695] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.228695] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.228889] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.229046] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.229211] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 10f26e0c-bbb8-4c94-9aa4-be74e7de2091 not found, creating... [ 1461.229546] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.229743] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.229889] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.230568] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.230568] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.230731] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.230936] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.231119] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.231339] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.231504] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.231658] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 10f26e0c-bbb8-4c94-9aa4-be74e7de2091 is going to be created. [ 1461.254768] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.255079] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.255155] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.255389] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.255621] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.255861] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-10f26e0c-bbb8-4c94-9aa4-be74e7de2091" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.932465] env[70614]: INFO networking_nsxv3.common.synchronization [req-8edc8f1e-416f-4f9b-9a9c-49bd906f0fae req-d7cb8d6e-2989-4b06-a2f8-7b14834f19ac service nova] Enqueued Resource ID: 822e878a-4ff6-4b05-bb6e-6fa1772d2841 with Priority: HIGHEST for action security_group_rules [ 1461.932663] env[70614]: INFO networking_nsxv3.common.synchronization [req-8edc8f1e-416f-4f9b-9a9c-49bd906f0fae req-d7cb8d6e-2989-4b06-a2f8-7b14834f19ac service nova] Enqueued Resource ID: 822e878a-4ff6-4b05-bb6e-6fa1772d2841 with Priority: HIGHEST for action security_group_members [ 1461.932829] env[70614]: INFO networking_nsxv3.common.synchronization [req-8edc8f1e-416f-4f9b-9a9c-49bd906f0fae req-d7cb8d6e-2989-4b06-a2f8-7b14834f19ac service nova] Enqueued Resource ID: 10f26e0c-bbb8-4c94-9aa4-be74e7de2091 with Priority: HIGHEST for action port [ 1461.933512] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 822e878a-4ff6-4b05-bb6e-6fa1772d2841 with Priority: HIGHEST for action security_group_rules [ 1461.933585] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 822e878a-4ff6-4b05-bb6e-6fa1772d2841 with Priority: HIGHEST for action security_group_members [ 1461.933698] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10f26e0c-bbb8-4c94-9aa4-be74e7de2091 with Priority: HIGHEST for action port [ 1461.933940] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-822e878a-4ff6-4b05-bb6e-6fa1772d2841 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.934210] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-822e878a-4ff6-4b05-bb6e-6fa1772d2841" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.934210] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-822e878a-4ff6-4b05-bb6e-6fa1772d2841" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.934447] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-822e878a-4ff6-4b05-bb6e-6fa1772d2841" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.934447] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('822e878a-4ff6-4b05-bb6e-6fa1772d2841',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1461.935323] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-822e878a-4ff6-4b05-bb6e-6fa1772d2841 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.935404] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-822e878a-4ff6-4b05-bb6e-6fa1772d2841" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.935455] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-822e878a-4ff6-4b05-bb6e-6fa1772d2841" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.935633] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-822e878a-4ff6-4b05-bb6e-6fa1772d2841" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.935776] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.935868] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.935928] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.936075] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.936232] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.936232] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('822e878a-4ff6-4b05-bb6e-6fa1772d2841',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1461.937409] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-10f26e0c-bbb8-4c94-9aa4-be74e7de2091 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.938054] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-10f26e0c-bbb8-4c94-9aa4-be74e7de2091" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.938054] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-10f26e0c-bbb8-4c94-9aa4-be74e7de2091" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.938054] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-10f26e0c-bbb8-4c94-9aa4-be74e7de2091" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.938054] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10f26e0c-bbb8-4c94-9aa4-be74e7de2091',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1462.440522] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('822e878a-4ff6-4b05-bb6e-6fa1772d2841',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1462.441598] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-822e878a-4ff6-4b05-bb6e-6fa1772d2841 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.441717] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-822e878a-4ff6-4b05-bb6e-6fa1772d2841" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.441869] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 10f26e0c-bbb8-4c94-9aa4-be74e7de2091 with status ACTIVE [ 1462.442033] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.442168] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.442233] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.442426] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.442511] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.442679] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.442778] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.442846] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.442979] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.443060] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.443246] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.443517] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.443517] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.443662] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.443739] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.443830] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 10f26e0c-bbb8-4c94-9aa4-be74e7de2091 is going to be updated. [ 1462.465840] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.466150] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.466150] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.466299] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.466382] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.466545] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-10f26e0c-bbb8-4c94-9aa4-be74e7de2091" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.945420] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('822e878a-4ff6-4b05-bb6e-6fa1772d2841',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1463.450589] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1463.451044] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1463.451044] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1463.451044] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1463.451171] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1463.451214] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 822e878a-4ff6-4b05-bb6e-6fa1772d2841 is going to be created. [ 1463.475763] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1463.476027] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1463.476027] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1463.476291] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1463.476360] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1463.486215] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 822e878a-4ff6-4b05-bb6e-6fa1772d2841 in Status: UNINITIALIZED for 2s [ 1464.572096] env[70614]: INFO networking_nsxv3.common.synchronization [req-9809c99e-422c-4378-9228-591135b64ca3 req-e9bb915b-5717-4d1b-8486-1fabd69efa84 tempest-AttachVolumeNegativeTest-1085254203 tempest-AttachVolumeNegativeTest-1085254203-project-member] Enqueued Resource ID: 60333446-97ce-4f78-835e-24cf4d7aaf23 with Priority: HIGHEST for action security_group_members [ 1464.572646] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60333446-97ce-4f78-835e-24cf4d7aaf23 with Priority: HIGHEST for action security_group_members [ 1464.572941] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-60333446-97ce-4f78-835e-24cf4d7aaf23 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1464.573081] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60333446-97ce-4f78-835e-24cf4d7aaf23" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1464.573153] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60333446-97ce-4f78-835e-24cf4d7aaf23" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1464.573388] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60333446-97ce-4f78-835e-24cf4d7aaf23" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1464.573544] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1464.573646] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1464.573712] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1464.573854] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1464.573939] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1464.574043] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60333446-97ce-4f78-835e-24cf4d7aaf23',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1464.851487] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-574 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1464.851757] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-574" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1464.851920] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-574" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1464.852283] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-574" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1464.852594] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1464.852790] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1464.852923] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1464.853265] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1464.853501] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1464.853779] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1464.853926] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1464.854080] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1464.854200] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1464.854342] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1464.854459] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1464.854635] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1464.872809] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1464.873038] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1464.873162] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1464.873386] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-574" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1464.873761] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-3b3e1719-ef56-406e-92ea-a77230fa13b0 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1464.874045] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-3b3e1719-ef56-406e-92ea-a77230fa13b0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1464.874139] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-3b3e1719-ef56-406e-92ea-a77230fa13b0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1464.874485] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-3b3e1719-ef56-406e-92ea-a77230fa13b0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1464.874651] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b3e1719-ef56-406e-92ea-a77230fa13b0',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1465.076100] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1465.076334] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1465.076334] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1465.076458] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1465.076550] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1465.076754] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1465.076853] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1465.076922] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1465.077075] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1465.077154] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1465.077240] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60333446-97ce-4f78-835e-24cf4d7aaf23 already deleted. [ 1465.077321] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60333446-97ce-4f78-835e-24cf4d7aaf23" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1465.377499] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1465.377735] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1465.377803] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1465.378122] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1465.378277] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1465.378442] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 3b3e1719-ef56-406e-92ea-a77230fa13b0 not found, creating... [ 1465.378714] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1465.378882] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1465.379014] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1465.379247] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1465.379390] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1465.379686] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1465.379851] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1465.379970] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1465.380203] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1465.380371] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1465.380607] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 3b3e1719-ef56-406e-92ea-a77230fa13b0 is going to be created. [ 1465.404640] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1465.405215] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1465.405534] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1465.405953] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1465.406276] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1465.406639] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-3b3e1719-ef56-406e-92ea-a77230fa13b0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1465.503789] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 822e878a-4ff6-4b05-bb6e-6fa1772d2841 in Status: SUCCESS [ 1465.504039] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-822e878a-4ff6-4b05-bb6e-6fa1772d2841" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1465.504243] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-822e878a-4ff6-4b05-bb6e-6fa1772d2841" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1465.504561] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-822e878a-4ff6-4b05-bb6e-6fa1772d2841" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1465.504926] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1465.505099] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1465.505194] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1465.505634] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1465.505634] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1465.505634] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-822e878a-4ff6-4b05-bb6e-6fa1772d2841" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1465.505879] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('822e878a-4ff6-4b05-bb6e-6fa1772d2841',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1466.008606] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('822e878a-4ff6-4b05-bb6e-6fa1772d2841',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1466.088131] env[70614]: INFO networking_nsxv3.common.synchronization [req-9809c99e-422c-4378-9228-591135b64ca3 req-8f47f477-63ee-43bc-96ff-308fe3b04550 service nova] Enqueued Resource ID: 60333446-97ce-4f78-835e-24cf4d7aaf23 with Priority: HIGHEST for action security_group_rules [ 1466.088319] env[70614]: INFO networking_nsxv3.common.synchronization [req-9809c99e-422c-4378-9228-591135b64ca3 req-8f47f477-63ee-43bc-96ff-308fe3b04550 service nova] Enqueued Resource ID: 60333446-97ce-4f78-835e-24cf4d7aaf23 with Priority: HIGHEST for action security_group_members [ 1466.088464] env[70614]: INFO networking_nsxv3.common.synchronization [req-9809c99e-422c-4378-9228-591135b64ca3 req-8f47f477-63ee-43bc-96ff-308fe3b04550 service nova] Enqueued Resource ID: 3b3e1719-ef56-406e-92ea-a77230fa13b0 with Priority: HIGHEST for action port [ 1466.088977] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60333446-97ce-4f78-835e-24cf4d7aaf23 with Priority: HIGHEST for action security_group_rules [ 1466.089126] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60333446-97ce-4f78-835e-24cf4d7aaf23 with Priority: HIGHEST for action security_group_members [ 1466.089220] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b3e1719-ef56-406e-92ea-a77230fa13b0 with Priority: HIGHEST for action port [ 1466.089481] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-60333446-97ce-4f78-835e-24cf4d7aaf23 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1466.089983] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-60333446-97ce-4f78-835e-24cf4d7aaf23" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1466.090086] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-60333446-97ce-4f78-835e-24cf4d7aaf23" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1466.090298] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-60333446-97ce-4f78-835e-24cf4d7aaf23" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1466.090391] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('60333446-97ce-4f78-835e-24cf4d7aaf23',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1466.091422] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-60333446-97ce-4f78-835e-24cf4d7aaf23 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1466.091547] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60333446-97ce-4f78-835e-24cf4d7aaf23" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1466.091611] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60333446-97ce-4f78-835e-24cf4d7aaf23" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1466.091791] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60333446-97ce-4f78-835e-24cf4d7aaf23" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1466.091940] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1466.092045] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1466.092108] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1466.092241] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1466.092326] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1466.092476] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60333446-97ce-4f78-835e-24cf4d7aaf23',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1466.093448] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-3b3e1719-ef56-406e-92ea-a77230fa13b0 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1466.093611] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3b3e1719-ef56-406e-92ea-a77230fa13b0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1466.093682] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3b3e1719-ef56-406e-92ea-a77230fa13b0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1466.093827] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3b3e1719-ef56-406e-92ea-a77230fa13b0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1466.094369] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b3e1719-ef56-406e-92ea-a77230fa13b0',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1466.510847] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 822e878a-4ff6-4b05-bb6e-6fa1772d2841: rpc.has_security_group_logging(os_id): False [ 1466.529301] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1466.529301] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1466.529301] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1466.529301] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1466.529607] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1466.529693] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1466.529835] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1466.529941] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1466.530192] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1466.530314] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1466.530416] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 822e878a-4ff6-4b05-bb6e-6fa1772d2841 is going to be created. [ 1466.586860] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1466.587096] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1466.587096] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1466.587318] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1466.587500] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1466.596704] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('60333446-97ce-4f78-835e-24cf4d7aaf23',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1466.597610] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-60333446-97ce-4f78-835e-24cf4d7aaf23 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1466.598536] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60333446-97ce-4f78-835e-24cf4d7aaf23" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1466.598536] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3b3e1719-ef56-406e-92ea-a77230fa13b0 with status ACTIVE [ 1466.598536] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1466.598536] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1466.598536] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1466.598813] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1466.599416] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1466.599416] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1466.599416] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1466.599416] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1466.599631] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1466.599631] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1466.599810] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1466.599920] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1466.599958] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1466.600165] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1466.600240] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1466.600402] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3b3e1719-ef56-406e-92ea-a77230fa13b0 is going to be updated. [ 1466.601894] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 822e878a-4ff6-4b05-bb6e-6fa1772d2841 in Status: IN_PROGRESS for 2s [ 1466.619812] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1466.619975] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1466.620057] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1466.620243] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1466.620409] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1466.620545] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3b3e1719-ef56-406e-92ea-a77230fa13b0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1467.103532] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('60333446-97ce-4f78-835e-24cf4d7aaf23',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1467.607063] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1467.607302] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1467.607302] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1467.607489] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1467.607539] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1467.607647] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60333446-97ce-4f78-835e-24cf4d7aaf23 is going to be created. [ 1467.630823] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1467.631014] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1467.631075] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1467.631259] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1467.631418] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1467.640898] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60333446-97ce-4f78-835e-24cf4d7aaf23 in Status: UNINITIALIZED for 2s [ 1468.617348] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 822e878a-4ff6-4b05-bb6e-6fa1772d2841 in Status: SUCCESS [ 1468.617820] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-822e878a-4ff6-4b05-bb6e-6fa1772d2841" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1469.652602] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60333446-97ce-4f78-835e-24cf4d7aaf23 in Status: SUCCESS [ 1469.652969] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60333446-97ce-4f78-835e-24cf4d7aaf23" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1469.652969] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60333446-97ce-4f78-835e-24cf4d7aaf23" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1469.653198] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60333446-97ce-4f78-835e-24cf4d7aaf23" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1469.653391] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1469.653565] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1469.653655] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1469.653816] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1469.653897] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1469.653985] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60333446-97ce-4f78-835e-24cf4d7aaf23" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1469.654088] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('60333446-97ce-4f78-835e-24cf4d7aaf23',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1470.157949] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('60333446-97ce-4f78-835e-24cf4d7aaf23',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1470.660512] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 60333446-97ce-4f78-835e-24cf4d7aaf23: rpc.has_security_group_logging(os_id): False [ 1470.678542] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1470.678752] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1470.678795] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1470.679016] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1470.679105] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1470.679364] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1470.679464] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1470.679531] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1470.679669] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1470.679744] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1470.679829] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 60333446-97ce-4f78-835e-24cf4d7aaf23 is going to be created. [ 1470.733324] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1470.733601] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1470.733601] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1470.733874] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1470.734084] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1470.748445] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 60333446-97ce-4f78-835e-24cf4d7aaf23 in Status: IN_PROGRESS for 2s [ 1471.090372] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1471.090707] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1472.763070] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 60333446-97ce-4f78-835e-24cf4d7aaf23 in Status: SUCCESS [ 1472.763446] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-60333446-97ce-4f78-835e-24cf4d7aaf23" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1476.091549] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1476.092048] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1481.093061] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1481.093461] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1486.094644] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1486.095061] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1491.096298] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1491.096673] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1496.097669] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1496.097979] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1501.099244] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1501.099677] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1506.100445] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1506.100845] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1511.102132] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1511.102631] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1516.103433] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1516.103843] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1521.104542] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1521.104929] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1526.105478] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1526.105478] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1528.682270] env[70614]: INFO networking_nsxv3.common.synchronization [req-3884b43b-34ea-4b57-bd3c-1a4fdb46b9aa req-0c2c9be3-0579-4550-9579-011cf87bea62 tempest-AttachVolumeNegativeTest-1085254203 tempest-AttachVolumeNegativeTest-1085254203-project-member] Enqueued Resource ID: 60333446-97ce-4f78-835e-24cf4d7aaf23 with Priority: HIGHEST for action security_group_members [ 1528.683192] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60333446-97ce-4f78-835e-24cf4d7aaf23 with Priority: HIGHEST for action security_group_members [ 1528.684264] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-60333446-97ce-4f78-835e-24cf4d7aaf23 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1528.684451] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60333446-97ce-4f78-835e-24cf4d7aaf23" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1528.684561] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60333446-97ce-4f78-835e-24cf4d7aaf23" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1528.684948] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60333446-97ce-4f78-835e-24cf4d7aaf23" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1528.685496] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1528.685496] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1528.685496] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1528.685823] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1528.685938] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1528.686377] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60333446-97ce-4f78-835e-24cf4d7aaf23',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1529.189206] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1529.189459] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1529.189459] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1529.189660] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1529.189731] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1529.189921] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1529.190060] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1529.190123] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1529.190233] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1529.190309] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1529.190396] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60333446-97ce-4f78-835e-24cf4d7aaf23 is going to be updated. [ 1529.234426] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1529.234691] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1529.234691] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1529.234851] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1529.234995] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1529.248276] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60333446-97ce-4f78-835e-24cf4d7aaf23 in Status: IN_PROGRESS for 2s [ 1531.259121] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60333446-97ce-4f78-835e-24cf4d7aaf23 in Status: SUCCESS [ 1531.259496] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60333446-97ce-4f78-835e-24cf4d7aaf23 deletion is rescheduled due to dependency. [ 1531.259496] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60333446-97ce-4f78-835e-24cf4d7aaf23" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1531.718349] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-657 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.718349] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-657" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.718349] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-657" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1531.718349] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-657" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1531.718349] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.718832] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.718832] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1531.718832] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1531.718989] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1531.719168] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1531.719257] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1531.719371] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1531.719552] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1531.719623] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1531.719718] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1531.719822] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1531.738919] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1531.739147] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1531.739248] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1531.739473] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-657" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1531.739780] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-10f26e0c-bbb8-4c94-9aa4-be74e7de2091 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.739900] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-10f26e0c-bbb8-4c94-9aa4-be74e7de2091" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.739986] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-10f26e0c-bbb8-4c94-9aa4-be74e7de2091" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1531.740270] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-10f26e0c-bbb8-4c94-9aa4-be74e7de2091" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1531.740411] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10f26e0c-bbb8-4c94-9aa4-be74e7de2091',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1532.242428] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.242664] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.242796] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.243153] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.243311] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.243604] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.243767] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.243910] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.244170] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.244312] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.244593] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.244753] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.244874] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.245096] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.245232] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.245375] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 10f26e0c-bbb8-4c94-9aa4-be74e7de2091 is going to be updated. [ 1532.265867] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.266330] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.266330] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.266482] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.266662] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.266880] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-10f26e0c-bbb8-4c94-9aa4-be74e7de2091" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.957462] env[70614]: INFO networking_nsxv3.common.synchronization [req-cb827378-aa55-4f09-b772-5c9493d30e18 req-7ddf8a22-89b9-4ba7-bd93-bad2c50567e7 service nova] Enqueued Resource ID: 822e878a-4ff6-4b05-bb6e-6fa1772d2841 with Priority: HIGHEST for action security_group_rules [ 1532.957658] env[70614]: INFO networking_nsxv3.common.synchronization [req-cb827378-aa55-4f09-b772-5c9493d30e18 req-7ddf8a22-89b9-4ba7-bd93-bad2c50567e7 service nova] Enqueued Resource ID: 822e878a-4ff6-4b05-bb6e-6fa1772d2841 with Priority: HIGHEST for action security_group_members [ 1532.957802] env[70614]: INFO networking_nsxv3.common.synchronization [req-cb827378-aa55-4f09-b772-5c9493d30e18 req-7ddf8a22-89b9-4ba7-bd93-bad2c50567e7 service nova] Enqueued Resource ID: 10f26e0c-bbb8-4c94-9aa4-be74e7de2091 with Priority: HIGHEST for action port [ 1532.958308] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 822e878a-4ff6-4b05-bb6e-6fa1772d2841 with Priority: HIGHEST for action security_group_rules [ 1532.958444] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 822e878a-4ff6-4b05-bb6e-6fa1772d2841 with Priority: HIGHEST for action security_group_members [ 1532.958546] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10f26e0c-bbb8-4c94-9aa4-be74e7de2091 with Priority: HIGHEST for action port [ 1532.958805] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-822e878a-4ff6-4b05-bb6e-6fa1772d2841 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.958929] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-822e878a-4ff6-4b05-bb6e-6fa1772d2841" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.958993] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-822e878a-4ff6-4b05-bb6e-6fa1772d2841" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.959201] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-822e878a-4ff6-4b05-bb6e-6fa1772d2841" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.959283] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('822e878a-4ff6-4b05-bb6e-6fa1772d2841',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1532.960089] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-822e878a-4ff6-4b05-bb6e-6fa1772d2841 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.960189] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-822e878a-4ff6-4b05-bb6e-6fa1772d2841" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.960233] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-822e878a-4ff6-4b05-bb6e-6fa1772d2841" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.960396] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-822e878a-4ff6-4b05-bb6e-6fa1772d2841" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.960533] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.960626] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.960688] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.960838] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.960914] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.960978] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('822e878a-4ff6-4b05-bb6e-6fa1772d2841',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1532.961823] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-10f26e0c-bbb8-4c94-9aa4-be74e7de2091 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.961823] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-10f26e0c-bbb8-4c94-9aa4-be74e7de2091" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.961823] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-10f26e0c-bbb8-4c94-9aa4-be74e7de2091" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.961988] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-10f26e0c-bbb8-4c94-9aa4-be74e7de2091" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.962059] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10f26e0c-bbb8-4c94-9aa4-be74e7de2091',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1533.463321] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('822e878a-4ff6-4b05-bb6e-6fa1772d2841',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1533.464419] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-822e878a-4ff6-4b05-bb6e-6fa1772d2841 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.464524] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-822e878a-4ff6-4b05-bb6e-6fa1772d2841" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.464880] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 10f26e0c-bbb8-4c94-9aa4-be74e7de2091 with status ACTIVE [ 1533.465057] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.465196] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.465254] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.465457] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.465544] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1533.465708] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.465801] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.465863] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.466016] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.466096] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1533.466273] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.466366] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.466429] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.466564] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.466637] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1533.466719] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 10f26e0c-bbb8-4c94-9aa4-be74e7de2091 is going to be updated. [ 1533.486929] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.487160] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.487160] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.487348] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.487481] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1533.487634] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-10f26e0c-bbb8-4c94-9aa4-be74e7de2091" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1533.966355] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('822e878a-4ff6-4b05-bb6e-6fa1772d2841',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1534.388867] env[70614]: INFO networking_nsxv3.common.synchronization [None req-db782059-8e12-4719-af09-ec25a7726460 tempest-AttachVolumeNegativeTest-1085254203 tempest-AttachVolumeNegativeTest-1085254203-project-member] Enqueued Resource ID: ac207f5c-8cf9-49d8-9877-49a44a622e20 with Priority: HIGHEST for action security_group_rules [ 1534.389538] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac207f5c-8cf9-49d8-9877-49a44a622e20 with Priority: HIGHEST for action security_group_rules [ 1534.389896] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac207f5c-8cf9-49d8-9877-49a44a622e20 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.390206] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac207f5c-8cf9-49d8-9877-49a44a622e20" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.390360] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac207f5c-8cf9-49d8-9877-49a44a622e20" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.390689] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac207f5c-8cf9-49d8-9877-49a44a622e20" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.390841] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac207f5c-8cf9-49d8-9877-49a44a622e20',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1534.458292] env[70614]: INFO networking_nsxv3.common.synchronization [None req-c729fd94-bd0e-4e67-a83e-32dcd655c82e tempest-AttachVolumeNegativeTest-1085254203 tempest-AttachVolumeNegativeTest-1085254203-project-member] Enqueued Resource ID: ac207f5c-8cf9-49d8-9877-49a44a622e20 with Priority: HIGHEST for action security_group_rules [ 1534.458821] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac207f5c-8cf9-49d8-9877-49a44a622e20 with Priority: HIGHEST for action security_group_rules [ 1534.459197] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac207f5c-8cf9-49d8-9877-49a44a622e20 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.459317] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac207f5c-8cf9-49d8-9877-49a44a622e20" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.469337] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.469690] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.469690] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.469858] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.469968] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.470104] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 822e878a-4ff6-4b05-bb6e-6fa1772d2841 is going to be updated. [ 1534.501911] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.502153] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.502153] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.502341] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.502583] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.512669] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 822e878a-4ff6-4b05-bb6e-6fa1772d2841 in Status: IN_PROGRESS for 2s [ 1534.909794] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.909971] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.910049] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.910247] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.910343] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.910436] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac207f5c-8cf9-49d8-9877-49a44a622e20 already deleted. [ 1534.910572] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac207f5c-8cf9-49d8-9877-49a44a622e20" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.910663] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac207f5c-8cf9-49d8-9877-49a44a622e20" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.910837] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac207f5c-8cf9-49d8-9877-49a44a622e20" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.910924] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac207f5c-8cf9-49d8-9877-49a44a622e20',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1535.432030] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.432198] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1535.432198] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1535.432416] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1535.432505] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1535.432604] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac207f5c-8cf9-49d8-9877-49a44a622e20 already deleted. [ 1535.432690] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac207f5c-8cf9-49d8-9877-49a44a622e20" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.523817] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 822e878a-4ff6-4b05-bb6e-6fa1772d2841 in Status: SUCCESS [ 1536.524398] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-822e878a-4ff6-4b05-bb6e-6fa1772d2841" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.524517] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-822e878a-4ff6-4b05-bb6e-6fa1772d2841" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.524730] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-822e878a-4ff6-4b05-bb6e-6fa1772d2841" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.524993] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.525182] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.525310] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.525543] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.525679] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.525830] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-822e878a-4ff6-4b05-bb6e-6fa1772d2841" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.525976] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('822e878a-4ff6-4b05-bb6e-6fa1772d2841',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1537.028477] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('822e878a-4ff6-4b05-bb6e-6fa1772d2841',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1537.531248] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 822e878a-4ff6-4b05-bb6e-6fa1772d2841: rpc.has_security_group_logging(os_id): False [ 1537.552583] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.552803] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.552803] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.552985] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.553100] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.553354] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.553457] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.553523] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.553680] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.553757] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.553842] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 822e878a-4ff6-4b05-bb6e-6fa1772d2841 is going to be updated. [ 1537.612187] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.612391] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.612464] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.612663] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.612910] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.628383] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 822e878a-4ff6-4b05-bb6e-6fa1772d2841 in Status: IN_PROGRESS for 2s [ 1539.459662] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1539.459662] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1539.645067] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 822e878a-4ff6-4b05-bb6e-6fa1772d2841 in Status: SUCCESS [ 1539.645483] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-822e878a-4ff6-4b05-bb6e-6fa1772d2841" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1539.758810] env[70614]: INFO networking_nsxv3.common.synchronization [req-e4bed514-6721-4a69-bd8e-9620ae0b6d0c req-d5189cc6-c94a-4125-be80-f6ceebe60c29 tempest-AttachVolumeNegativeTest-1085254203 tempest-AttachVolumeNegativeTest-1085254203-project-member] Enqueued Resource ID: ac207f5c-8cf9-49d8-9877-49a44a622e20 with Priority: HIGHEST for action security_group_members [ 1539.762014] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac207f5c-8cf9-49d8-9877-49a44a622e20 with Priority: HIGHEST for action security_group_members [ 1539.762014] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac207f5c-8cf9-49d8-9877-49a44a622e20 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.762014] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac207f5c-8cf9-49d8-9877-49a44a622e20" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.762014] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac207f5c-8cf9-49d8-9877-49a44a622e20" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1539.762014] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac207f5c-8cf9-49d8-9877-49a44a622e20" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1539.762014] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.762014] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.762014] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1539.762014] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1539.762014] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1539.762014] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac207f5c-8cf9-49d8-9877-49a44a622e20',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1540.045605] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock network-574 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1540.045605] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "network-574" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1540.045849] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "network-574" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1540.045942] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "network-574" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1540.046241] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1540.046413] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1540.046539] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1540.046763] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1540.046938] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.047180] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1540.047294] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] NeedRegenerationException {{(pid=70614) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1540.047408] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] no value, waiting for create lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1540.047530] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] value creation lock acquired {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1540.047648] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] No value present for key: 'zone-id' {{(pid=70614) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1540.047758] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Calling creation function for not-yet-present value {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1540.047915] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1540.068901] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1540.069106] env[70614]: DEBUG dogpile.cache.region [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70614) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1540.069766] env[70614]: DEBUG dogpile.lock [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Released creation lock {{(pid=70614) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1540.069766] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "network-574" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.069766] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock port-2cee3a0b-44fd-4917-a161-09c4d8c52750 taken with stack trace [, , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1540.070071] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "port-2cee3a0b-44fd-4917-a161-09c4d8c52750" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1540.070113] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "port-2cee3a0b-44fd-4917-a161-09c4d8c52750" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1540.070426] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "port-2cee3a0b-44fd-4917-a161-09c4d8c52750" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1540.070573] env[70614]: DEBUG networking_nsxv3.api.rpc [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2cee3a0b-44fd-4917-a161-09c4d8c52750',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1540.263633] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1540.263915] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1540.263973] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1540.264289] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1540.264422] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.264723] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1540.264904] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1540.265016] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1540.265182] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1540.265269] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.265364] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac207f5c-8cf9-49d8-9877-49a44a622e20 already deleted. [ 1540.265441] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac207f5c-8cf9-49d8-9877-49a44a622e20" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.572619] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1540.572982] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1540.573051] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1540.573316] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1540.573506] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.573715] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Segment Port 2cee3a0b-44fd-4917-a161-09c4d8c52750 not found, creating... [ 1540.574059] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1540.574237] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1540.574363] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1540.574626] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1540.574775] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.575064] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1540.575249] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1540.575381] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1540.575620] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1540.575771] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.575915] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Resource: SegmentPort with ID: 2cee3a0b-44fd-4917-a161-09c4d8c52750 is going to be created. [ 1540.595459] env[70614]: DEBUG networking_nsxv3.common.locking [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1540.595648] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1540.595767] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1540.596030] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1540.596265] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.596488] env[70614]: DEBUG oslo_concurrency.lockutils [None req-3f351c2d-5150-43cc-babe-4a57e9d70537 None None] Releasing lock "port-2cee3a0b-44fd-4917-a161-09c4d8c52750" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1541.586804] env[70614]: INFO networking_nsxv3.common.synchronization [req-e4bed514-6721-4a69-bd8e-9620ae0b6d0c req-88647a9a-2f4c-4ec4-815a-863ac3b06471 service nova] Enqueued Resource ID: ac207f5c-8cf9-49d8-9877-49a44a622e20 with Priority: HIGHEST for action security_group_rules [ 1541.587177] env[70614]: INFO networking_nsxv3.common.synchronization [req-e4bed514-6721-4a69-bd8e-9620ae0b6d0c req-88647a9a-2f4c-4ec4-815a-863ac3b06471 service nova] Enqueued Resource ID: ac207f5c-8cf9-49d8-9877-49a44a622e20 with Priority: HIGHEST for action security_group_members [ 1541.587298] env[70614]: INFO networking_nsxv3.common.synchronization [req-e4bed514-6721-4a69-bd8e-9620ae0b6d0c req-88647a9a-2f4c-4ec4-815a-863ac3b06471 service nova] Enqueued Resource ID: 2cee3a0b-44fd-4917-a161-09c4d8c52750 with Priority: HIGHEST for action port [ 1541.587996] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac207f5c-8cf9-49d8-9877-49a44a622e20 with Priority: HIGHEST for action security_group_rules [ 1541.588277] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac207f5c-8cf9-49d8-9877-49a44a622e20 with Priority: HIGHEST for action security_group_members [ 1541.588471] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cee3a0b-44fd-4917-a161-09c4d8c52750 with Priority: HIGHEST for action port [ 1541.588803] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac207f5c-8cf9-49d8-9877-49a44a622e20 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.588986] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac207f5c-8cf9-49d8-9877-49a44a622e20" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.589177] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac207f5c-8cf9-49d8-9877-49a44a622e20" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.589478] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac207f5c-8cf9-49d8-9877-49a44a622e20" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.589667] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac207f5c-8cf9-49d8-9877-49a44a622e20',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1541.590883] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac207f5c-8cf9-49d8-9877-49a44a622e20 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.591199] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac207f5c-8cf9-49d8-9877-49a44a622e20" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.591298] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac207f5c-8cf9-49d8-9877-49a44a622e20" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.591546] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac207f5c-8cf9-49d8-9877-49a44a622e20" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.591780] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.591962] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.592112] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.592489] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.592626] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1541.592764] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac207f5c-8cf9-49d8-9877-49a44a622e20',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1541.593736] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock port-2cee3a0b-44fd-4917-a161-09c4d8c52750 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.593922] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2cee3a0b-44fd-4917-a161-09c4d8c52750" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.594047] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2cee3a0b-44fd-4917-a161-09c4d8c52750" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.594256] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2cee3a0b-44fd-4917-a161-09c4d8c52750" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.594379] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2cee3a0b-44fd-4917-a161-09c4d8c52750',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1542.096979] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac207f5c-8cf9-49d8-9877-49a44a622e20 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1542.096979] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac207f5c-8cf9-49d8-9877-49a44a622e20" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1542.096979] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac207f5c-8cf9-49d8-9877-49a44a622e20',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1542.097983] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2cee3a0b-44fd-4917-a161-09c4d8c52750 with status ACTIVE [ 1542.098227] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1542.098347] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1542.098415] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1542.098620] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1542.098711] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.098878] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1542.098984] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1542.099045] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1542.099184] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1542.099265] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.099442] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1542.099534] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1542.099592] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1542.099732] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1542.099806] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.099892] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2cee3a0b-44fd-4917-a161-09c4d8c52750 is going to be updated. [ 1542.122577] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1542.122827] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1542.122827] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1542.123049] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1542.123202] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.123366] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2cee3a0b-44fd-4917-a161-09c4d8c52750" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.602568] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac207f5c-8cf9-49d8-9877-49a44a622e20',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1543.105066] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1543.105324] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1543.105324] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1543.105553] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1543.105642] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1543.105744] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac207f5c-8cf9-49d8-9877-49a44a622e20 is going to be created. [ 1543.129579] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1543.129931] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1543.129931] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1543.130066] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1543.130170] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1543.141069] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac207f5c-8cf9-49d8-9877-49a44a622e20 in Status: UNINITIALIZED for 2s [ 1545.152671] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac207f5c-8cf9-49d8-9877-49a44a622e20 in Status: SUCCESS [ 1545.153189] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac207f5c-8cf9-49d8-9877-49a44a622e20" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1545.153189] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac207f5c-8cf9-49d8-9877-49a44a622e20" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.153352] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac207f5c-8cf9-49d8-9877-49a44a622e20" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.153522] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.153634] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.153694] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.153848] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.153926] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1545.153997] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac207f5c-8cf9-49d8-9877-49a44a622e20" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1545.154112] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ac207f5c-8cf9-49d8-9877-49a44a622e20',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1545.657172] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ac207f5c-8cf9-49d8-9877-49a44a622e20',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1546.160019] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ac207f5c-8cf9-49d8-9877-49a44a622e20: rpc.has_security_group_logging(os_id): False [ 1546.178884] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.179123] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.179235] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.179540] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.179678] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.180054] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.180221] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.180354] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.180554] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.180670] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.180798] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac207f5c-8cf9-49d8-9877-49a44a622e20 is going to be created. [ 1546.241724] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.241968] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.241968] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.242127] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.242325] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.253729] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac207f5c-8cf9-49d8-9877-49a44a622e20 in Status: IN_PROGRESS for 2s [ 1546.589510] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1546.589726] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1548.266494] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac207f5c-8cf9-49d8-9877-49a44a622e20 in Status: SUCCESS [ 1548.266810] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac207f5c-8cf9-49d8-9877-49a44a622e20" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.268750] env[70614]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] NSXv3 Agent Agent loop - iteration:3 completed [ 1550.269233] env[70614]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-bdaaf89c-d3a4-4349-bd07-779a88d56476 None None] NSXv3 Agent Agent loop - iteration:4 started [ 1551.590509] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1551.590807] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1556.591417] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1556.591727] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1561.592398] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1561.592881] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1566.593589] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1566.593589] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1571.594922] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1571.595358] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1576.596026] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1576.596445] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1581.596823] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1581.597139] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1583.946105] env[70614]: INFO networking_nsxv3.common.synchronization [req-7cca85a4-063d-46d8-954e-7cefe4afb853 req-d21ceba6-3d6e-4011-b7bc-9481b99e8052 tempest-AttachVolumeShelveTestJSON-232337985 tempest-AttachVolumeShelveTestJSON-232337985-project-member] Enqueued Resource ID: 822e878a-4ff6-4b05-bb6e-6fa1772d2841 with Priority: HIGHEST for action security_group_members [ 1583.946638] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 822e878a-4ff6-4b05-bb6e-6fa1772d2841 with Priority: HIGHEST for action security_group_members [ 1583.946953] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-822e878a-4ff6-4b05-bb6e-6fa1772d2841 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.947220] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-822e878a-4ff6-4b05-bb6e-6fa1772d2841" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1583.947294] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-822e878a-4ff6-4b05-bb6e-6fa1772d2841" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.947543] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-822e878a-4ff6-4b05-bb6e-6fa1772d2841" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.947710] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.947842] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1583.947888] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.948051] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.948152] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1583.948248] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('822e878a-4ff6-4b05-bb6e-6fa1772d2841',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1584.451078] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.451078] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.451078] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.451410] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.451410] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.451482] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.451547] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.451666] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.451761] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.451840] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.451927] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 822e878a-4ff6-4b05-bb6e-6fa1772d2841 is going to be updated. [ 1584.482248] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.482531] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.482531] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.482650] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.482773] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.491103] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 822e878a-4ff6-4b05-bb6e-6fa1772d2841 in Status: IN_PROGRESS for 2s [ 1586.501550] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 822e878a-4ff6-4b05-bb6e-6fa1772d2841 in Status: SUCCESS [ 1586.501992] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 822e878a-4ff6-4b05-bb6e-6fa1772d2841 deletion is rescheduled due to dependency. [ 1586.501992] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-822e878a-4ff6-4b05-bb6e-6fa1772d2841" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1588.947860] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1588.947860] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1592.231256] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.231714] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.231714] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.231714] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.231839] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1592.735193] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1593.238309] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1593.739974] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1593.740101] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1593.948583] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1593.948728] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1594.515786] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1594.516117] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1594.516117] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1594.516290] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1594.529651] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1594.665329] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1594.667068] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1594.705703] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1594.705861] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1594.705981] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1594.706203] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1594.721870] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1594.722631] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1594.722703] env[70614]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=70614) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1594.722797] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1594.755638] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1594.755860] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1594.755860] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1594.756059] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1594.756787] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1594.756938] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1594.832399] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1594.832690] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1594.832690] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1594.832821] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1594.833144] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1594.833484] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1594.905610] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1594.905851] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1594.905851] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1594.906041] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1594.906337] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1594.906634] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:27. [ 1594.906725] env[70614]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'a034d096-40a8-4ee7-8cb1-e9d03d795d6a', 'b6d86fb6-2897-4e0b-8601-d87ed7fe208e', 'def9aa42-470d-498e-9034-6879fb1e6ebc', '822e878a-4ff6-4b05-bb6e-6fa1772d2841', '2f835b02-0885-4d88-8d2d-4a47ba0a1993', '336e562f-9c8e-4021-953e-5756518b10b0', '3496e6be-51c4-4b7a-9789-b13bae7f2cda', 'ad8b8cdd-7eee-48c2-8c33-7b83fde75038', '1440acfc-c5d6-4a44-b0a8-654c4f16a7d1', 'ac207f5c-8cf9-49d8-9877-49a44a622e20', '45904912-7759-4b89-83ba-2a95c86ca5fd', 'ecaff113-395f-46a3-b8a5-a3ce5cb003a5', '76d591d6-9294-4288-b5c9-f6b7e2b45562', '406660af-f92d-476c-ab5f-e3168c58847d', '77b7addf-0db2-4091-a32b-1272c6ac49b5', 'b20ed1f0-7f46-40ac-882f-36a610d96a98', '77761344-a891-4e31-9381-80451d04a355', 'dd5a38a7-babd-4c6b-b3a5-af13dd79865d', '60333446-97ce-4f78-835e-24cf4d7aaf23', 'ec4cc5da-964e-43e8-9531-6581ec387b4d', '3f4770f9-9c1b-48b7-8d14-3089a02098e4', 'e8c65e5a-d52c-481c-a6b2-680dae9a4593', 'ced2222f-152a-4951-8da3-65259a9e32af', 'f0060547-03fb-4d1a-ad8e-69519760b908', '3172accd-a4e8-4297-999e-158d19f8d74b', '63a56402-3dcf-44d4-b33d-a56ff531a12c', '94eb8a38-d1bf-4747-a73b-c4d0ea236bc3'} {{(pid=70614) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1594.906820] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1594.926087] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1594.926385] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1594.926385] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1594.926563] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1594.926563] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1594.926679] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1594.926739] env[70614]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=70614) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1594.926801] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1595.006485] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1595.006780] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1595.006780] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1595.006933] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1595.008120] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1595.008426] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1595.008494] env[70614]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=70614) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1595.008566] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1595.008626] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1595.008701] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/27 resources of Type:Security Group Rules [ 1595.008771] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a034d096-40a8-4ee7-8cb1-e9d03d795d6a with Priority: HIGH for action security_group_rules [ 1595.008848] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b6d86fb6-2897-4e0b-8601-d87ed7fe208e with Priority: HIGH for action security_group_rules [ 1595.008910] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: def9aa42-470d-498e-9034-6879fb1e6ebc with Priority: HIGH for action security_group_rules [ 1595.008963] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 822e878a-4ff6-4b05-bb6e-6fa1772d2841 with Priority: HIGH for action security_group_rules [ 1595.009037] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2f835b02-0885-4d88-8d2d-4a47ba0a1993 with Priority: HIGH for action security_group_rules [ 1595.009097] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 336e562f-9c8e-4021-953e-5756518b10b0 with Priority: HIGH for action security_group_rules [ 1595.009167] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3496e6be-51c4-4b7a-9789-b13bae7f2cda with Priority: HIGH for action security_group_rules [ 1595.009257] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ad8b8cdd-7eee-48c2-8c33-7b83fde75038 with Priority: HIGH for action security_group_rules [ 1595.009312] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 with Priority: HIGH for action security_group_rules [ 1595.009375] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ac207f5c-8cf9-49d8-9877-49a44a622e20 with Priority: HIGH for action security_group_rules [ 1595.009426] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 45904912-7759-4b89-83ba-2a95c86ca5fd with Priority: HIGH for action security_group_rules [ 1595.009489] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ecaff113-395f-46a3-b8a5-a3ce5cb003a5 with Priority: HIGH for action security_group_rules [ 1595.009541] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 with Priority: HIGH for action security_group_rules [ 1595.009608] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 406660af-f92d-476c-ab5f-e3168c58847d with Priority: HIGH for action security_group_rules [ 1595.009694] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 77b7addf-0db2-4091-a32b-1272c6ac49b5 with Priority: HIGH for action security_group_rules [ 1595.009756] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b20ed1f0-7f46-40ac-882f-36a610d96a98 with Priority: HIGH for action security_group_rules [ 1595.009811] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 77761344-a891-4e31-9381-80451d04a355 with Priority: HIGH for action security_group_rules [ 1595.009869] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dd5a38a7-babd-4c6b-b3a5-af13dd79865d with Priority: HIGH for action security_group_rules [ 1595.009930] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 60333446-97ce-4f78-835e-24cf4d7aaf23 with Priority: HIGH for action security_group_rules [ 1595.009992] env[70614]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ec4cc5da-964e-43e8-9531-6581ec387b4d with Priority: HIGH for action security_group_rules [ 1595.010098] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1598.949538] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1598.949829] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1598.949829] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a034d096-40a8-4ee7-8cb1-e9d03d795d6a with Priority: HIGH for action security_group_rules [ 1598.949908] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: def9aa42-470d-498e-9034-6879fb1e6ebc with Priority: HIGH for action security_group_rules [ 1598.949999] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3496e6be-51c4-4b7a-9789-b13bae7f2cda with Priority: HIGH for action security_group_rules [ 1598.950115] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77b7addf-0db2-4091-a32b-1272c6ac49b5 with Priority: HIGH for action security_group_rules [ 1598.950213] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec4cc5da-964e-43e8-9531-6581ec387b4d with Priority: HIGH for action security_group_rules [ 1598.950307] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60333446-97ce-4f78-835e-24cf4d7aaf23 with Priority: HIGH for action security_group_rules [ 1598.950401] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd5a38a7-babd-4c6b-b3a5-af13dd79865d with Priority: HIGH for action security_group_rules [ 1598.950485] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77761344-a891-4e31-9381-80451d04a355 with Priority: HIGH for action security_group_rules [ 1598.950576] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 406660af-f92d-476c-ab5f-e3168c58847d with Priority: HIGH for action security_group_rules [ 1598.950664] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b20ed1f0-7f46-40ac-882f-36a610d96a98 with Priority: HIGH for action security_group_rules [ 1598.950749] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 with Priority: HIGH for action security_group_rules [ 1598.950834] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ecaff113-395f-46a3-b8a5-a3ce5cb003a5 with Priority: HIGH for action security_group_rules [ 1598.950922] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45904912-7759-4b89-83ba-2a95c86ca5fd with Priority: HIGH for action security_group_rules [ 1598.951015] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac207f5c-8cf9-49d8-9877-49a44a622e20 with Priority: HIGH for action security_group_rules [ 1598.951099] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 with Priority: HIGH for action security_group_rules [ 1598.951202] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 336e562f-9c8e-4021-953e-5756518b10b0 with Priority: HIGH for action security_group_rules [ 1598.951310] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad8b8cdd-7eee-48c2-8c33-7b83fde75038 with Priority: HIGH for action security_group_rules [ 1598.951423] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f835b02-0885-4d88-8d2d-4a47ba0a1993 with Priority: HIGH for action security_group_rules [ 1598.951505] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6d86fb6-2897-4e0b-8601-d87ed7fe208e with Priority: HIGH for action security_group_rules [ 1598.951593] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 822e878a-4ff6-4b05-bb6e-6fa1772d2841 with Priority: HIGH for action security_group_rules [ 1598.951940] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a034d096-40a8-4ee7-8cb1-e9d03d795d6a taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.952082] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a034d096-40a8-4ee7-8cb1-e9d03d795d6a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.952159] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a034d096-40a8-4ee7-8cb1-e9d03d795d6a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.952371] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a034d096-40a8-4ee7-8cb1-e9d03d795d6a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.952513] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a034d096-40a8-4ee7-8cb1-e9d03d795d6a',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1598.953615] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-def9aa42-470d-498e-9034-6879fb1e6ebc taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.953615] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.953790] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.953887] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.953940] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('def9aa42-470d-498e-9034-6879fb1e6ebc',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1598.954924] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3496e6be-51c4-4b7a-9789-b13bae7f2cda taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.957822] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3496e6be-51c4-4b7a-9789-b13bae7f2cda" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.957822] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3496e6be-51c4-4b7a-9789-b13bae7f2cda" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.957822] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3496e6be-51c4-4b7a-9789-b13bae7f2cda" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.957822] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3496e6be-51c4-4b7a-9789-b13bae7f2cda',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1598.958488] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-77b7addf-0db2-4091-a32b-1272c6ac49b5 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.958640] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-77b7addf-0db2-4091-a32b-1272c6ac49b5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.958744] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-77b7addf-0db2-4091-a32b-1272c6ac49b5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.958897] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-77b7addf-0db2-4091-a32b-1272c6ac49b5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.959036] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('77b7addf-0db2-4091-a32b-1272c6ac49b5',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1598.960476] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ec4cc5da-964e-43e8-9531-6581ec387b4d taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.960476] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ec4cc5da-964e-43e8-9531-6581ec387b4d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.960644] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ec4cc5da-964e-43e8-9531-6581ec387b4d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.960705] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ec4cc5da-964e-43e8-9531-6581ec387b4d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.960758] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ec4cc5da-964e-43e8-9531-6581ec387b4d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1598.961436] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-60333446-97ce-4f78-835e-24cf4d7aaf23 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.961539] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-60333446-97ce-4f78-835e-24cf4d7aaf23" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.961660] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-60333446-97ce-4f78-835e-24cf4d7aaf23" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.961752] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-60333446-97ce-4f78-835e-24cf4d7aaf23" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.961821] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('60333446-97ce-4f78-835e-24cf4d7aaf23',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1598.962499] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dd5a38a7-babd-4c6b-b3a5-af13dd79865d taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.962605] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dd5a38a7-babd-4c6b-b3a5-af13dd79865d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.962671] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dd5a38a7-babd-4c6b-b3a5-af13dd79865d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.962817] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dd5a38a7-babd-4c6b-b3a5-af13dd79865d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.962895] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dd5a38a7-babd-4c6b-b3a5-af13dd79865d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1598.963706] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-77761344-a891-4e31-9381-80451d04a355 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.963831] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-77761344-a891-4e31-9381-80451d04a355" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.963893] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-77761344-a891-4e31-9381-80451d04a355" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.964081] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-77761344-a891-4e31-9381-80451d04a355" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.964227] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('77761344-a891-4e31-9381-80451d04a355',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1598.965032] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-406660af-f92d-476c-ab5f-e3168c58847d taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.965157] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.965217] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.965362] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.965430] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('406660af-f92d-476c-ab5f-e3168c58847d',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1598.966115] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b20ed1f0-7f46-40ac-882f-36a610d96a98 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.966279] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b20ed1f0-7f46-40ac-882f-36a610d96a98" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.966279] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b20ed1f0-7f46-40ac-882f-36a610d96a98" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.966436] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b20ed1f0-7f46-40ac-882f-36a610d96a98" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.966505] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b20ed1f0-7f46-40ac-882f-36a610d96a98',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1598.967269] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-76d591d6-9294-4288-b5c9-f6b7e2b45562 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.967366] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.967449] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.967583] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.967664] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('76d591d6-9294-4288-b5c9-f6b7e2b45562',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1598.968295] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ecaff113-395f-46a3-b8a5-a3ce5cb003a5 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.968403] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ecaff113-395f-46a3-b8a5-a3ce5cb003a5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.968471] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ecaff113-395f-46a3-b8a5-a3ce5cb003a5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.968609] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ecaff113-395f-46a3-b8a5-a3ce5cb003a5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.968703] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ecaff113-395f-46a3-b8a5-a3ce5cb003a5',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1598.969333] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45904912-7759-4b89-83ba-2a95c86ca5fd taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.969443] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45904912-7759-4b89-83ba-2a95c86ca5fd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.969508] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45904912-7759-4b89-83ba-2a95c86ca5fd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.970333] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45904912-7759-4b89-83ba-2a95c86ca5fd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.970333] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45904912-7759-4b89-83ba-2a95c86ca5fd',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1598.970756] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac207f5c-8cf9-49d8-9877-49a44a622e20 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.970756] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac207f5c-8cf9-49d8-9877-49a44a622e20" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.970756] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac207f5c-8cf9-49d8-9877-49a44a622e20" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.970756] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac207f5c-8cf9-49d8-9877-49a44a622e20" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.970922] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac207f5c-8cf9-49d8-9877-49a44a622e20',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1598.971512] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.971628] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.971682] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.971819] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.971885] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1440acfc-c5d6-4a44-b0a8-654c4f16a7d1',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1598.972538] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-336e562f-9c8e-4021-953e-5756518b10b0 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.972639] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-336e562f-9c8e-4021-953e-5756518b10b0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.972699] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-336e562f-9c8e-4021-953e-5756518b10b0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.972833] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-336e562f-9c8e-4021-953e-5756518b10b0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.972899] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('336e562f-9c8e-4021-953e-5756518b10b0',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1598.973682] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad8b8cdd-7eee-48c2-8c33-7b83fde75038 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.973794] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad8b8cdd-7eee-48c2-8c33-7b83fde75038" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.973837] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad8b8cdd-7eee-48c2-8c33-7b83fde75038" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.973994] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad8b8cdd-7eee-48c2-8c33-7b83fde75038" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.974076] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad8b8cdd-7eee-48c2-8c33-7b83fde75038',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1598.974755] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f835b02-0885-4d88-8d2d-4a47ba0a1993 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.974861] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f835b02-0885-4d88-8d2d-4a47ba0a1993" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.974937] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f835b02-0885-4d88-8d2d-4a47ba0a1993" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.975082] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f835b02-0885-4d88-8d2d-4a47ba0a1993" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.975154] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f835b02-0885-4d88-8d2d-4a47ba0a1993',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1598.975828] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b6d86fb6-2897-4e0b-8601-d87ed7fe208e taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.975929] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b6d86fb6-2897-4e0b-8601-d87ed7fe208e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.975995] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b6d86fb6-2897-4e0b-8601-d87ed7fe208e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.976148] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b6d86fb6-2897-4e0b-8601-d87ed7fe208e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.976225] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b6d86fb6-2897-4e0b-8601-d87ed7fe208e',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1598.976872] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock rules-822e878a-4ff6-4b05-bb6e-6fa1772d2841 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.976977] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-822e878a-4ff6-4b05-bb6e-6fa1772d2841" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.977056] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-822e878a-4ff6-4b05-bb6e-6fa1772d2841" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.977207] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-822e878a-4ff6-4b05-bb6e-6fa1772d2841" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.977278] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('822e878a-4ff6-4b05-bb6e-6fa1772d2841',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1599.003414] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.003637] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.003637] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1599.003835] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1599.005832] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.005832] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.024669] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1599.024824] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dd5a38a7-babd-4c6b-b3a5-af13dd79865d is going to be deleted. [ 1599.025659] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1599.025879] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1599.044871] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1599.045041] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 76d591d6-9294-4288-b5c9-f6b7e2b45562 is going to be deleted. [ 1599.078340] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.078538] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.078538] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1599.078756] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1599.078849] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1599.078968] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dd5a38a7-babd-4c6b-b3a5-af13dd79865d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1599.091512] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.091697] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.091697] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1599.091901] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1599.091991] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1599.092121] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-76d591d6-9294-4288-b5c9-f6b7e2b45562" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1599.482261] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.482506] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.482506] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1599.482655] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1599.486309] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac207f5c-8cf9-49d8-9877-49a44a622e20 taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.486464] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac207f5c-8cf9-49d8-9877-49a44a622e20" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.486522] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac207f5c-8cf9-49d8-9877-49a44a622e20" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1599.486661] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac207f5c-8cf9-49d8-9877-49a44a622e20" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1599.486834] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.486937] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.487012] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1599.487201] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1599.487303] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1599.487396] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac207f5c-8cf9-49d8-9877-49a44a622e20" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1599.487483] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ac207f5c-8cf9-49d8-9877-49a44a622e20',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1599.536400] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.536631] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.543252] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.543449] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.554192] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.554372] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.555141] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.555238] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.555932] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.556039] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.558420] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.558546] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.559265] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.559357] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.560041] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.560139] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.560824] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.560918] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.561635] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.561722] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.562317] env[70614]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1599.562718] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.562809] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.563419] env[70614]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1599.563801] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.563890] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.564531] env[70614]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1599.564927] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.565019] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.565632] env[70614]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1599.566018] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.566128] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.566700] env[70614]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1599.567134] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1599.567239] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 77b7addf-0db2-4091-a32b-1272c6ac49b5 is going to be deleted. [ 1599.568630] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.568758] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.568832] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1599.569048] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1599.570396] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.570493] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.588015] env[70614]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1599.588521] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1599.588648] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 822e878a-4ff6-4b05-bb6e-6fa1772d2841 is going to be deleted. [ 1599.589549] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1599.589766] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1599.609655] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1599.609820] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b20ed1f0-7f46-40ac-882f-36a610d96a98 is going to be deleted. [ 1599.610655] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1599.610874] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1599.630985] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.631242] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.634123] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1599.634256] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b6d86fb6-2897-4e0b-8601-d87ed7fe208e is going to be deleted. [ 1599.635142] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1599.635354] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1599.636665] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.636779] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.655824] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.656048] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.657293] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1599.657413] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad8b8cdd-7eee-48c2-8c33-7b83fde75038 is going to be deleted. [ 1599.658283] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1599.658495] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1599.675208] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1599.675366] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a034d096-40a8-4ee7-8cb1-e9d03d795d6a is going to be deleted. [ 1599.676146] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1599.676354] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1599.695997] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1599.696183] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 406660af-f92d-476c-ab5f-e3168c58847d is going to be deleted. [ 1599.697016] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1599.697240] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1599.698623] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.698807] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.734829] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.735085] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.765894] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1599.766110] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3496e6be-51c4-4b7a-9789-b13bae7f2cda is going to be deleted. [ 1599.766943] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1599.767182] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1599.812776] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.813050] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.829139] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.829354] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.837970] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1599.838136] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 60333446-97ce-4f78-835e-24cf4d7aaf23 is going to be deleted. [ 1599.839080] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1599.839307] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1599.885685] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.885916] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.887697] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1599.887878] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 336e562f-9c8e-4021-953e-5756518b10b0 is going to be deleted. [ 1599.888742] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1599.888978] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1599.920375] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1599.920585] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f835b02-0885-4d88-8d2d-4a47ba0a1993 is going to be deleted. [ 1599.921511] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1599.921748] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1599.967149] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.967589] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1600.000027] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ac207f5c-8cf9-49d8-9877-49a44a622e20',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1600.002787] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.002988] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 77761344-a891-4e31-9381-80451d04a355 is going to be deleted. [ 1600.004018] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.004266] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.038977] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1600.039220] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1600.042844] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1600.043032] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1600.045762] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.045935] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ecaff113-395f-46a3-b8a5-a3ce5cb003a5 is going to be deleted. [ 1600.046949] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.047222] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.102497] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.102733] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45904912-7759-4b89-83ba-2a95c86ca5fd is going to be deleted. [ 1600.103698] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.103827] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.189264] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.189464] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: def9aa42-470d-498e-9034-6879fb1e6ebc is going to be deleted. [ 1600.190357] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.190577] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.207246] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1600.207422] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1600.209525] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1600.209656] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1600.219891] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.220056] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1440acfc-c5d6-4a44-b0a8-654c4f16a7d1 is going to be deleted. [ 1600.220969] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.221222] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.338675] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1600.338909] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1600.343362] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.343521] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ec4cc5da-964e-43e8-9531-6581ec387b4d is going to be deleted. [ 1600.344503] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.344724] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.344819] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.344945] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-77b7addf-0db2-4091-a32b-1272c6ac49b5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.345126] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.345290] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.345375] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.345498] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-822e878a-4ff6-4b05-bb6e-6fa1772d2841" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.346125] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.346436] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.346532] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.346678] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b20ed1f0-7f46-40ac-882f-36a610d96a98" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.346826] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.346982] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.347090] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.347230] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b6d86fb6-2897-4e0b-8601-d87ed7fe208e" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.347366] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.347551] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.347627] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.347697] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad8b8cdd-7eee-48c2-8c33-7b83fde75038" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.347821] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.347960] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.348044] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.348211] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a034d096-40a8-4ee7-8cb1-e9d03d795d6a" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.348275] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.348413] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.348490] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.348598] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-406660af-f92d-476c-ab5f-e3168c58847d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.348720] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.348855] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.348930] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.349054] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3496e6be-51c4-4b7a-9789-b13bae7f2cda" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.349187] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.349325] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.349400] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.349508] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-60333446-97ce-4f78-835e-24cf4d7aaf23" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.349635] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.349772] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.349843] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.349953] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-336e562f-9c8e-4021-953e-5756518b10b0" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.350101] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.350285] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.350366] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.350480] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f835b02-0885-4d88-8d2d-4a47ba0a1993" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.350605] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.350743] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.350816] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.350924] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ecaff113-395f-46a3-b8a5-a3ce5cb003a5" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.351067] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.351204] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.351277] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.351387] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-77761344-a891-4e31-9381-80451d04a355" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.351507] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.351642] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.351714] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.351817] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45904912-7759-4b89-83ba-2a95c86ca5fd" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.394651] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1600.394891] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1600.394891] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.395100] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.395191] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.395315] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-def9aa42-470d-498e-9034-6879fb1e6ebc" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.419951] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1600.420203] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1600.420203] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.420376] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.420464] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.420582] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1440acfc-c5d6-4a44-b0a8-654c4f16a7d1" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.449328] env[70614]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1600.449860] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1600.449993] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1600.450135] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.450288] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.450378] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.450486] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ec4cc5da-964e-43e8-9531-6581ec387b4d" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.506137] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ac207f5c-8cf9-49d8-9877-49a44a622e20: rpc.has_security_group_logging(os_id): False [ 1600.531915] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1600.532183] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1600.532183] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.532345] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.590019] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.590544] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1600.590779] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1600.590884] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.591190] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.591337] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.591467] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac207f5c-8cf9-49d8-9877-49a44a622e20 is going to be updated. [ 1600.666569] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1600.666785] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1600.666836] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.667056] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.667208] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.680951] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac207f5c-8cf9-49d8-9877-49a44a622e20 in Status: IN_PROGRESS for 2s [ 1601.356416] env[70614]: INFO networking_nsxv3.common.synchronization [req-1ec61295-fd00-4dcd-9a92-8012bc3c2b85 req-5c7de498-209d-4cd5-b715-ea495e84f747 tempest-AttachVolumeNegativeTest-1085254203 tempest-AttachVolumeNegativeTest-1085254203-project-member] Enqueued Resource ID: ac207f5c-8cf9-49d8-9877-49a44a622e20 with Priority: HIGHEST for action security_group_members [ 1601.356976] env[70614]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac207f5c-8cf9-49d8-9877-49a44a622e20 with Priority: HIGHEST for action security_group_members [ 1601.357295] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac207f5c-8cf9-49d8-9877-49a44a622e20 taken with stack trace [, , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1601.357420] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac207f5c-8cf9-49d8-9877-49a44a622e20" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1601.357490] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac207f5c-8cf9-49d8-9877-49a44a622e20" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1601.357669] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac207f5c-8cf9-49d8-9877-49a44a622e20" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1601.357813] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1601.357923] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1601.357985] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1601.358129] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1601.358199] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1601.358297] env[70614]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac207f5c-8cf9-49d8-9877-49a44a622e20',) {} {{(pid=70614) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1601.860751] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1601.860981] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1601.861052] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1601.861280] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1601.861395] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1601.861603] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1601.861700] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1601.861764] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1601.861938] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1601.862010] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1601.862092] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac207f5c-8cf9-49d8-9877-49a44a622e20 is going to be updated. [ 1601.894313] env[70614]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70614) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1601.894567] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1601.894567] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1601.894754] env[70614]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1601.894898] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1601.903814] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac207f5c-8cf9-49d8-9877-49a44a622e20 in Status: IN_PROGRESS for 2s [ 1602.695110] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac207f5c-8cf9-49d8-9877-49a44a622e20 in Status: SUCCESS [ 1602.695563] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac207f5c-8cf9-49d8-9877-49a44a622e20" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1603.914375] env[70614]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac207f5c-8cf9-49d8-9877-49a44a622e20 in Status: SUCCESS [ 1603.914761] env[70614]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac207f5c-8cf9-49d8-9877-49a44a622e20 deletion is rescheduled due to dependency. [ 1603.914761] env[70614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac207f5c-8cf9-49d8-9877-49a44a622e20" {{(pid=70614) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1606.358082] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1606.358564] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1611.359249] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1611.359682] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1616.360325] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1616.362318] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1621.361467] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1621.361928] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1626.362743] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1626.363205] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1631.364694] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1631.364694] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1636.365443] env[70614]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1636.365871] env[70614]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0